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ABSTRACT 


Vision-Based  Precision  Landings  of  a  Tailsitter  UAV 


P.  Travis  Millet 

Department  of  Mechanical  Engineering 
Master  of  Science 


We  present  a  method  of  performing  precision  landings  of  a  vertical  take-off  and  landing 
(VTOL)  unmanned  air  vehicle  (UAV)  with  the  use  of  an  onboard  vision  sensor  and  information 
about  the  aircraft’s  orientation  and  altitude  above  ground  level  (AGL).  A  method  for  calculating 
the  3-dimensional  location  of  the  UAV  relative  to  a  ground  target  of  interest  is  presented  as  well 
as  a  navigational  controller  to  position  the  UAV  above  the  target.  A  method  is  also  presented  to 
prevent  the  UAV  from  moving  in  a  way  that  will  cause  the  ground  target  of  interest  to  go  out  of 
view  of  the  UAV’s  onboard  camera.  These  methods  are  tested  in  simulation  and  in  hardware  and 
resulting  data  is  shown.  Hardware  flight  testing  yielded  an  average  position  estimation  error  of  22 
centimeters.  The  method  presented  is  capable  of  performing  precision  landings  of  VTOL  UAV’s 
with  submeter  accuracy. 


Keywords:  vision-based  navigation,  precision  landing,  unmanned  tailsitter,  VTOL,  UAV 


ACKNOWLEDGMENTS 


Ed  like  to  thank  the  members  of  my  graduate  committee,  Dr.  McLain,  Dr.  Beard,  and 
Dr.  Colton,  for  all  their  excellent  help,  suggestions,  and  contributions  to  this  research.  I’d  also 
like  to  thanks  the  many  members  of  the  BYU  MAGICC  lab  that  have  helped  to  contribute  to  this 
research.  In  particular,  I’d  like  to  thank  my  predecessor,  Nate  Knoebel,  for  his  contributions  and 
well  documented  work  in  autonomous  tailsitter  control.  I’d  like  to  thank  Neil  Johnson  for  taking 
me  under  his  wing,  (or  rotor  blade  seems  more  appropriate),  and  mentoring  me  in  the  beginning  of 
this  research.  Much  thanks  also  to  Bryce  Ready  for  hours  spent  at  the  whiteboard  hammering  out 
the  more  elusive  details  of  this  work  with  me.  My  thanks  also  go  out  to  the  many  MAGICC  lab  re¬ 
searchers  including  Rajnikant  Sharma,  Brett  Millar,  Liang  (Solomon)  Sun,  Huili  Yu,  Jacob  Bishop, 
Jeff  Saunders,  James  Hall,  Dan  Carlson,  and  the  many  others  that  have  been  great  colleagues  and 
friends.  An  enormous  thanks  to  the  Wright-Patterson  AFB  /i  AVIARI  operations,  specifically  Capt. 
Ryan  Carr  and  Doug  Szczublewski,  for  their  hard  work,  help,  and  sacrifice  in  acquiring  the  hard¬ 
ware  flight  data  presented  in  this  work.  Lastly,  I’d  like  to  thank  my  wife  Michelle  and  my  son 
Peter  for  showering  me  with  laughter  and  love  while  I  was  in  the  pit  of  research  frustrations,  and 
for  basking  with  me  in  the  ecstacy  of  hardware  results. 


TABLE  OF  CONTENTS 


LIST  OF  TABLES .  vi 

LIST  OF  FIGURES . viii 

NOMENCLATURE .  x 

Chapter  1  Introduction .  1 

LI  Motivation .  1 

1.2  Background .  3 

1.3  Contributions .  4 

1.4  Document  Organization .  4 

Chapter  2  UAV  Testbed  .  7 

2.1  UAV  Simulation  Environment  .  7 

2.2  Flight  Test  Setup  .  8 

2.2.1  Airframe .  9 

2.2.2  Vision  System  .  10 

2.2.3  Attitude  and  Altitude  Estimation  System  .  10 

2.2.4  Ground  Station  Software .  11 

Chapter  3  Aircraft  Stabilization,  Altitude,  and  Navigation  Control .  13 

3.1  Attitude  Controller .  13 

3.1.1  Simulation  Attitude  Controller .  14 

3.1.2  Hardware  Attitude  Controller  .  15 

3.1.3  Attitude  Controller  Results .  17 

3.2  Altitude  Controller .  19 

3.2.1  Simulation  Altitude  Controller .  20 

3.2.2  Hardware  Altitude  Controller  .  21 

3.2.3  Altitude  Controller  Results .  22 

3.3  Navigation  Controller .  23 

3.3.1  Hardware  Navigation  Controller .  24 

3.3.2  Navigation  Controller  Results .  26 

Chapter  4  Relative  Position  Estimation .  29 

4. 1  Coordinate  Frames .  29 

4.2  Pinhole  Camera  Model .  31 

4.3  Target  Detection .  32 

4.3.1  Color  Segmentation  .  33 

4.3.2  Connected  Components  .  33 

4.3.3  Centroid  Computation .  35 

4.4  Coordinate  Transformations  .  35 

4.5  Results .  36 


IV 


4.5.1  Position  Estimation  Simulation  Results .  37 

4.5.2  Position  Estimation  Hardware  Results .  39 

Chapter  5  Desired  Attitude  Saturation .  43 

5.1  Desired  Attitude  Saturation  in  Quaternions .  45 

5.2  Desired  Attitude  Saturation  in  Euler  Angles .  49 

5.2.1  Pitch  Saturation  Angles  .  49 

5.2.2  Roll  Saturation  Angles .  51 

5.3  Navigation  and  Cushion  Zones .  52 

5.4  Results .  53 

5.4.1  Attitude  Saturation  Simulation  Results .  53 

5.4.2  Attitude  Saturation  Hardware  Results .  54 

Chapter  6  Conclusions  and  Recommendations .  61 

6.1  Conclusions .  61 

6.2  Recommendations  for  Future  Work .  62 

REFERENCES .  65 

Appendix  A  Derivation  of  the  Desired  Quaternion .  67 

Appendix  B  Simulation  Forces,  Torques,  and  Equations  of  Motion  .  71 

B.l  Propeller  Forces  and  Torques .  71 

B.2  Propeller  Wash  Forces  and  Torques .  73 

B.2.1  Aileron .  74 

B.2. 2  Elevator .  75 

B.2. 3  Rudder .  76 

B.3  Level  Flight  Forces  and  Torques .  77 

B.4  Equations  of  Motion  .  79 


v 


LIST  OF  TABLES 


4.1  Relative  position  estimation  flight  results .  41 

5.1  Attitude  saturation  flight  results .  59 

B.l  Aircraft  physical  parameters .  72 

B.2  Level  flight  coefficients .  78 


vii 


LIST  OF  FIGURES 


1.1  Examples  of  Unmanned  Tailsitters .  2 

2.1  Simulated  Video  used  to  Simulate  Vision-Based  Landings  .  7 

2.2  Schematic  of  Controller  used  in  Simulation .  8 

2.3  Helicopter  Testbed  .  9 

2.4  Vision  System  on  Helicopter  Testbed .  10 

2.5  Ground  Station  Video  Hardware .  11 

3. 1  Block  Diagrams  of  PID  Attitude  Controllers  used  in  Flight  Testing .  16 

3.2  Comparison  of  Desired  and  Actual  Attitude  States  from  Simulation  Flight  Tests.  .  .  17 

3.3  Error  between  Aircraft’s  Attitude  and  Desired  Attitude  in  Hardware  Flight  Testing.  18 

3.4  Block  Diagrams  of  PID  Attitude  Controllers  used  in  Flight  Testing .  19 

3.5  Error  between  Aircraft’s  Attitude  and  Desired  Attitude  in  Hardware  Flight  Testing.  20 

3.6  Block  Diagram  of  Altitude  Controller  used  in  Simulation .  21 

3.7  Block  Diagram  of  Altitude  Controller  used  in  Flight  Testing .  22 

3.8  Altitude  Simulation  Results .  23 

3.9  Altitude  Flight  Test  Results .  24 

3. 10  Block  Diagram  of  Navigation  x-Direction  Controller  used  in  Flight  Testing . 25 

3.11  Block  Diagram  of  Navigation  y-Direction  Controller  used  in  Flight  Testing . 25 

3.12  Desired  and  Actual  Location  of  Aircraft  in  Simulation .  26 

3. 13  Desired  and  Actual  Location  of  Aircraft  from  Flight  Testing .  27 

4.1  Inertial  Based  Reference  Frames .  30 

4.2  Several  Reference  Frames  used  in  Relative  Position  Estimation . 30 

4.3  Pinhole  Camera  Model .  31 

4.4  Connected  Components  of  a  Thresholded  Image .  34 

4.5  Flight  Path  used  in  Simulation  and  Hardware  Flight  Testing . 37 

4.6  Simulation  Results  of  Vision-Based  Relative  Position  Estimation  Algorithm .  38 

4.7  Hardware  Results  of  Vision-Based  Relative  Position  Estimation  Algorithm . 39 

5.1  Target  Centroid  in  the  Image  Frame  from  Motivating  Example .  44 

5.2  UAV  Position  from  Motivating  Example .  45 

5.3  View  Frustum  of  Tailsitter. .  46 

5.4  Angles  and  Distances  used  for  Attitude  Saturation  Computation . 48 

5.5  Maximum  and  Minimum  Euler  Angles  used  to  Keep  Ground  Target  in  View .  50 

5.6  Image  Cushion  and  Navigation  Zones .  52 

5.7  Desired  and  Saturated  Desired  Quaternion  Components  from  Simulation . 54 

5.8  Location  of  Target  Centroid  in  Image  Frame  from  Simulation . 55 

5.9  Location  of  Target  Centroid  in  Image  Frame  from  Flight  Testing .  56 

5.9  Location  of  Target  Centroid  in  Image  Frame  from  Flight  Testing .  57 

5.10  Location  of  Target  Centroid  in  Image  Frame  if  the  UAV  Tracked  the  Desired  Attitude.  58 

5.11  An  Example  of  Pitch  Saturation  in  Flight  Testing .  58 

B.  1  Sketch  of  Tailsitter  Geometry  and  Nomenclature .  72 

viii 


ix 


NOMENCLATURE 


Xuav  Calculated  x  location  of  the  UAV  in  the  target  coordinate  frame 

Fuav  Calculated  v  location  of  the  UAV  in  the  target  coordinate  frame 

^aircraft  Quaternion  describing  the  aircraft’s  orientation  expressed  in  the  inertial  frame 
^desired  Quaternion  describing  the  desired  aircraft  orientation  expressed  in  the  inertial  frame 
terror  Quaternion  describing  rotation  from  ^aircraft 10  ^desired  expressed  in  the  body  frame 
aaz  Gimbal  azimuth  angle 

del  Gimbal  elevation  angle 

Ry  Vehicle  frame  to  body  frame  rotation  matrix 

Rgb  Body  frame  to  gimbal  frame  rotation  matrix 

R8g  Gimbal  frame  to  gimbal- 1  frame  rotation  matrix 
R8^  Gimbal- 1  frame  to  gimbal-2  frame  rotation  matrix 
Rcg 2  Gimbal-2  frame  to  camera  frame  rotation  matrix 
K  Camera  calibration  matrix 

-^gtrans  A  translation  from  gimbal  frame  to  body  frame  as  measured 
Jgtrans  Y  translation  from  gimbal  frame  to  body  frame  as  measured 

Zgtrans  A  translation  from  gimbal  frame  to  body  frame  as  measured 

Apixei  A  centroid  of  the  target  in  the  image  frame 

Fpixei  Y  centroid  of  the  target  in  the  image  frame 

fx  Image  focal  length  in  the  image  frame  x  direction 

fy  Image  focal  length  in  the  image  frame  y  direction 

cx  Image  center  in  the  image  frame  x  direction 

cy  Image  center  in  the  image  frame  y  direction 

p  Roll  rate  of  the  aircraft 

q  Pitch  rate  of  the  aircraft 

r  Yaw  rate  of  the  aircraft 

8a  Aileron  command 

8e  Elevator  command 

8,  Rudder  command 


in  the  gimbal  frame 
in  the  gimbal  frame 
in  the  gimbal  frame 


x 


xi 


CHAPTER  1.  INTRODUCTION 


Tailsitter  aircraft  exhibit  many  potential  advantages  over  fixed-wing  and  helicopter  aircraft 
due  to  their  ability  to  fly  in  both  hover  flight  and  energy-efficient  forward  flight.  The  capability  to 
perform  precision  landings  at  a  desired  location  allows  a  tailsitter  to  utilize  many  of  the  advantages 
that  a  tailsitter  aircraft  has  over  conventional  fixed-wing  aircraft.  Motivation  for  this  research 
topic  is  given,  followed  by  a  description  of  previous  research  done  in  this  area.  The  contributions 
presented  by  this  work  are  offered,  followed  by  a  description  of  the  organization  of  this  document. 

1.1  Motivation 

Tailsitter  aircraft  have  the  capability  to  hover,  allowing  them  to  perform  perch-and-stare, 
descend-and-investigate,  and  drop/retrieve  missions.  This  capability  to  hover  also  allows  tailsitter 
aircraft  to  take  off  and  land  from  a  variety  of  locations  without  the  need  of  a  runway.  Tailsitter 
aircraft  are  also  able  to  transition  into  level  flight  where  lower  energy  consumption  and  faster 
speeds  can  be  achieved  [1],  The  versatility  of  taking  off  and  landing  without  a  runway  and  of 
being  able  to  conserve  energy  in  level  flight  makes  the  tailsitter  aircraft  an  appealing  candidate 
for  many  military  and  civilian  tasks.  However,  the  ability  to  perform  precision  hover  landings  at 
a  desired  location  is  paramount  to  many  of  the  aforementioned  tasks.  This  work  focuses  on  the 
precision  landing  of  tailsitter  unmanned  air  vehicles  (UAVs)  with  the  use  of  an  onboard  camera, 
an  estimate  of  the  aircraft’s  orientation  and  an  estimate  of  the  aircraft’s  altitude  above  ground  level 
(AGL). 

The  generally  accepted  method  of  determining  UAV  position  in  an  outdoor  environment  is 
to  use  a  global  positioning  system  (GPS)  device.  Conventional  GPS  provides  a  reliable  method 
of  determining  the  location  of  a  UAV  with  an  accuracy  of  5  to  20  meters  for  commercial  grade 
GPS  [2].  For  applications  with  a  required  landing  precision  of  less  than  1  meter,  commercial 
grade  GPS  units  cannot  provide  a  sufficiently  accurate  measurement.  Differential  GPS  units  are 
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Figure  1.1:  Examples  of  unmanned  tailsitter  aircraft,  from  left  to  right  are;  the  current  BYU  tail- 
sitter  airframe,  the  previous  BYU  tailsitter  airframe,  the  T-Wing  used  at  the  University  of  Syndey, 
the  VERTIGO  aircraft  used  at  the  Institut  Superieur  de  l’Aeronautique  et  de  l’espace  (ISAE),  a 
tailsitter  design  used  at  Massachusetts  Institute  of  Technology  (MIT). 

capable  of  achieving  submeter  precision  [3],  however,  differential  GPS  units  are  larger,  heavier, 
and  more  expensive  than  conventional  GPS  and  require  communication  with  a  stationary  ground 
unit  at  a  location  close  to  the  landing  site.  The  size  and  weight  of  differential  GPS  units  make  them 
infeasible  on  small,  space-limited  UAVs  and  weight-limited  vertical  take  off  and  landing  (VTOL) 
UAVs.  As  we  will  show,  a  small  and  lightweight  onboard  camera  is  a  viable  alternative  to  GPS  for 
providing  the  UAV  position  estimation  information  necessary  for  precision  landings. 

Vision-guided  precision  landings  are  made  possible  through  the  use  of  UAV  orientation 
information,  the  UAV’s  altitude  AGL,  and  the  pixel  coordinates  of  a  ground  target  in  the  image 
frame  of  a  camera  onboard  the  UAV.  With  this  information  the  position  of  the  aircraft  relative  to  a 
ground  target  can  be  calculated.  With  the  relative  position  between  the  UAV  and  the  target  known, 
the  aircraft  can  then  be  navigated  to  land  on  top  of  the  target  or  to  any  other  position  at  which  the 
target  is  still  visible  to  the  UAV’s  camera. 

One  of  the  difficulties  of  performing  the  vision-based  landing  of  a  tailsitter  in  hover  flight 
with  a  fixed,  downward  facing  camera  is  that,  as  the  tailsitter  tilts  to  move  toward  the  target,  there 
is  no  guarantee  that  the  target  will  remain  in  the  image  frame.  If  the  target  leaves  the  image  frame 
then  no  further  vision-based  position  estimates  can  be  calculated,  resulting  in  an  ever  increasing 
position  error.  Using  the  technique  described  in  this  paper,  it  is  critical  that  the  time  the  target  is 
not  in  the  camera  view  frustum  be  minimized.  For  this  reason  a  method  of  limiting  the  UAV’s 
desired  attitude  is  also  presented  in  order  to  keep  the  target  in  view  at  all  times. 
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1.2  Background 


This  paper  builds  on  work  done  by  Knoebel  et  al.  [4-6]  at  the  Brigham  Young  University 
Multiple  Agent  Intelligent  Coordination  and  Control  (MAGICC)  Lab.  Researchers  at  the  BYU 
MAGICC  Lab  developed  an  adaptive  controller  for  tailsitter  UAVs  in  both  vertical  and  horizontal 
modes  of  flight.  They  demonstrated  the  controller’s  effectiveness  in  level  and  vertical  flight  as  well 
as  in  performing  transitions  between  these  two  regimes.  Figure  1.1  shows  the  tailsitter  airframes 
used  for  previous  flight  testing  at  BYU  as  well  as  a  sampling  of  other  tailsitter  airframes  used  for 
research  by  various  universities. 

Research  into  vision-based  landings  of  fixed-wing  aircraft  has  been  explored  by  researchers 
at  Brigham  Young  University.  Barber  et  al.  [7, 8]  used  vision  to  estimate  a  desired  motion  vector 
used  to  land  a  UAV  on  a  ground  target.  Vision  was  also  used  to  estimate  bias  which  came  from 
camera  misalignment,  wind,  or  state  estimation  errors.  This  controller  was  used  to  land  a  fixed- 
wing  UAV  on  static  and  moving  targets,  both  with  successful  results. 

Hintze  and  Theodore  et  al.  [9-12]  demonstrated  the  use  of  vision-based  methods  to  land 
a  rotorcraft  UAV  in  a  GPS-denied  environment.  They  used  an  onboard  camera,  a  laser  range  unit 
and  an  inertial  measurement  unit  (IMU)  to  estimate  the  UAV’s  position  relative  to  a  fixed  point 
on  the  ground.  This  information  was  used  to  navigate  the  rotorcraft  to  the  ground  without  the  use 
of  GPS.  The  method  was  reported  to  be  accurate  enough  to  serve  as  an  alternative  to  GPS  data  in 
landing  maneuvers. 

Saripalli  et  al.  [13]  used  a  similar  approach  to  the  one  we  present  in  this  paper  to  land 
a  helicopter  on  top  of  a  marked  landing  pad.  They  used  color  thresholding  to  find  the  landing 
pad  and  computed  its  center  of  mass  and  orientation.  This  information  was  then  fused  with  GPS 
information  to  refine  the  position  estimate  of  the  aircraft.  The  helicopter  would  then  align  itself 
with  the  orientation  of  the  landing  pad  and  position  itself  over  the  target.  Additionally,  the  aircraft 
was  capable  of  performing  an  autonomous  search  for  the  landing  pad  as  well  as  tracking  a  moving 
target  and  landing  on  it  after  the  target  had  remained  fixed  for  a  period  of  time. 

Researchers  at  the  University  of  California  at  Berkeley  [14,  15]  have  performed  vision- 
based  landings  and  navigation  of  a  helicopter  by  computing  the  full  pose  of  the  helicopter  using 
linear  and  nonlinear  optimization  techniques  and  a  uniquely  defined  ground  target.  The  solution  of 
the  linear  optimization  of  the  pose  of  the  aircraft  was  used  to  initialize  a  nonlinear  optimization  to 
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find  a  robust  pose  estimate  of  the  UAV.  This  pose  estimate  was  then  combined  with  those  derived 
from  the  GPS  and  inertial  navigation  sensors  (INS)  sensors  to  calculate  a  more  accurate  estimate 
of  the  aircraft’s  pose.  The  helicopter  was  given  a  greater  range  of  motion  by  gimballing  the  camera 
to  not  lose  sight  of  the  target  used  for  navigation  [16]. 

How  et  al.  [17]  at  the  Massachusetts  Institute  of  Technology  Aerospace  Controls  Labora¬ 
tory  have  successfully  performed  precision  control  on  a  fixed-wing  aerobatic  RC  model  airplane 
using  an  offboard  VICON  MX  motion  capture  system.  Hover  flight,  level  flight,  transitions,  and 
precision  landings  were  performed  using  adaptive  control  and  the  VICON  MX  motion  capture  sys¬ 
tem.  Because  the  vision  system  is  offboard,  the  UAV  is  confined  to  areas  equipped  with  precision 
motion  capture  systems  to  acquire  UAV  position  information. 

1.3  Contributions 

Much  of  the  research  presented  here  is  shown  as  related  to  tailsitter  aircraft,  however,  much 
of  this  work  could  be  applied  to  other  vertical  take  off  and  landing  (VTOL)  airframes  or  to  vision- 
based  navigation  in  general.  The  contributions  made  by  this  work  are  as  follows: 

•  A  method  for  vision-based  landings  of  tailsitter  aircraft  is  developed  using  quaternions  as 
rotation  operators 

•  A  method  for  estimating  an  aircraft’s  position  relative  to  a  ground  target  using  the  aircraft’s 
orientation,  altitude  AGL,  and  an  onboard  camera  is  shown 

•  A  novel  method  used  to  saturate  an  aircraft’s  desired  attitude  is  provided  such  that  a  ground 
target  being  used  for  visual  navigation  does  not  leave  the  image  frame 

•  Simulation  and  hardware  flight  testing  is  used  to  validate  the  methods  presented 

1.4  Document  Organization 

Chapter  2  of  this  document  describes  the  UAV  testbed  used  for  flight  testing  as  well  as  the 
simulation  environment  used  to  test  the  methods  presented  in  this  work  prior  to  hardware  flight 
testing.  Chapter  3  describes  the  attitude,  altitude  and  navigational  controller  used  to  stabilize 
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the  aircraft  and  navigate  the  UAV  to  desired  locations.  Chapter  4  gives  a  brief  overview  of  the 
pinhole  camera  model  and  details  the  relative  position  estimation  algorithm  used  to  estimate  the 
UAV’s  position  relative  to  a  ground  target  of  interest.  Chapter  5  describes  the  novel  technique 
used  to  keep  the  ground  target  in  the  UAV’s  view  frustum  so  that  future  position  estimates  can  be 
acquired  and  navigation  to  the  ground  can  be  achieved.  In  Chapter  6  we  present  our  conclusions 
and  recommendations  for  future  work. 
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CHAPTER  2.  UAV  TESTBED 


The  vision-based  landing  research  presented  in  this  work  was  validated  via  computer  sim¬ 
ulation  and  by  performing  vision-based  landings  on  a  VTOL  UAV.  This  chapter  describes  the 
simulation  environment  used  to  test  the  precision  landing  method  and  the  hardware  setup  used  in 
performing  vision-based  landings  in  hardware  flight  testing. 

2.1  UAV  Simulation  Environment 

Computer  simulation  of  tailsitter  vision-based  landings  was  performed  to  gain  insight  into 
the  expected  performance  of  the  proposed  vision  guidance  controller  as  well  as  to  identify  unfore¬ 
seen  difficulties  in  performing  vision-based  landings.  Simulation  was  performed  in  the  Matlab 
Simulink  environment  using  simulated  video  streamed  from  the  open  source  Aviones  aircraft  sim¬ 
ulator  [18].  Simulated  video  from  the  Aviones  environment  is  shown  in  Figure  2.1.  The  scene 
rendered  by  Aviones  is  based  on  the  aircraft  states  passed  to  the  Aviones  visualizer  from  the  Mat- 
lab  simulator  and  is  the  scene  that  a  camera  facing  out  the  tail  end  of  the  aircraft  would  see  from 
onboard  the  UAV.  The  Aviones  video  was  then  processed  in  Matlab  to  determine  the  aircraft’s 
relative  position  to  the  target. 


Figure  2.1:  Video  screens  from  the  Aviones  environment  used  in  Matlab  simulation:  the  left  pane 
shows  the  orientation  of  the  UAV,  the  middle  pane  shows  the  scene  from  the  onboard  camera,  the 
right  pane  is  the  image  from  the  onboard  camera  after  color  segmentation. 
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Figure  2.2:  Schematic  of  the  controller  used  in  simulation. 

The  block  diagram  shown  in  Figure  2.2  shows  the  simulation  structure  used  to  simulate 
the  vision-based  landing  technique  presented  in  this  paper.  The  navigational  controller  shown 
in  Figure  2.2  receives  desired  positions  from  both  the  user  defined  waypoints  as  well  as  from 
the  vision  processing  program.  The  desired  waypoint  locations  from  the  vision  processing  block 
override  the  user-defined  waypoints  if  the  ground  target  of  interest  is  detected  in  the  video  frame. 
The  forces  and  moments  acting  on  the  aircraft  as  well  as  the  equations  of  motion  used  to  simulate 
tailsitter  aircraft  dynamics  are  described  in  detail  in  Appendix  B  as  described  in  [6]. 

2.2  Flight  Test  Setup 

The  vision-based  landing  technique  described  in  this  paper  was  tested  in  hardware  using 
an  autonomous  helicopter  UAV  equipped  with  onboard  vision.  While  the  research  of  vision-based 
precision  landings  presented  in  this  work  is  derived  for  precision  landings  of  tailsitter  aircraft,  this 
work  extends  beyond  tailsitter  airframes  to  the  vision-based  precision  landings  of  VTOL  aircraft 
in  general.  We  feel  that  the  use  of  a  helicopter  in  hardware  flight  testing  only  further  strengthens 
the  contributions  of  this  research  in  the  task  of  vision-based  landings  of  VTOL  platforms.  This 
section  also  describes  the  airframe,  sensors,  and  the  VICON  MX  motion  capture  system  used 
to  estimate  the  UAV’s  attitude  and  altitude,  that  were  used  to  validate  the  tailsitter  vision-based 
landing  techniques  described  in  this  document. 
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Figure  2.3:  Helicopter  testbed  used  for  flight  testing. 


2.2.1  Airframe 

The  testbed  used  to  validate  this  research  was  an  off-the-shelf  HeliMax  CPv3  remote  con¬ 
trolled  (RC)  helicopter  shown  in  Figure  2.3.  The  helicopter  has  a  20.75  inch  rotor  span  and  has 
a  total  weight  of  one  pound.  The  helicopter  uses  collective  rotor  pitch  for  altitude  control  and 
cyclic  rotor  pitch  for  both  roll  and  pitch  control.  A  tailrotor  at  the  end  of  the  helicopter’s  tail  boom 
controls  the  yaw  of  the  aircraft.  The  helicopter  is  driven  by  a  single  380  size  brushed  motor  and 
powered  by  an  Electrifly  11.1  volt,  950  mA-hr  lithium  polymer  battery.  The  motor  is  controlled  by 
a  12  amp  electronic  speed  control  also  made  by  Electrifly. 

The  helicopter  was  controlled  using  a  5-channel  72  Mhz  transmitter  and  an  onboard  re¬ 
ceiver.  Commands  were  sent  from  the  ground  station  to  the  onboard  servos  and  speed  control 
through  the  transmitter  either  by  the  control  algorithms  running  on  an  offboard  computer  or  by 
the  safety  pilot.  Helicopter  control  was  sent  to  the  RC  transmitter  from  the  offboard  computer 
via  a  trainer  cable  that  connected  into  the  back  of  the  transmitter.  The  safety  pilot  was  able  to 
switch  between  computer-in-control  (CIC)  mode  and  pilot-in-control  (PIC)  mode  using  a  toggle 
switch  located  on  the  RC  transmitter.  This  allowed  the  safety  pilot  to  take  control  in  the  event  of 
an  emergency. 
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Figure  2.4:  Video  system  mounted  on  the  helicopter  testbed  used  for  flight  testing. 

2.2.2  Vision  System 

A  RHPC-2005  1/4  inch  charge-coupled-device  (CCD)  OEM  color  camera  was  mounted  on 
the  helicopter  to  provide  onboard  video.  The  camera  required  five  volts  of  DC  power  and  provided 
640  by  480  pixels  of  resolution  that  was  transmitted  to  the  ground  station  using  a  500  mW  analog 
video  transmitter.  The  video  transmitter  and  the  camera  in  its  downward  facing  position,  can  be 
seen  mounted  on  the  helicopter  airframe  in  Figure  2.4. 

Video  sent  from  the  UAV  was  received  at  the  ground  station  using  a  12  volt,  eight  channel 
video  receiver  made  by  Black  Widow  AV.  A  KWorld  2820  framegrabber  was  used  to  convert 
the  analog  video  into  a  digital  format  for  processing  on  the  ground  station  computer.  The  video 
receiver  and  the  framegrabber  used  in  testing  can  be  seen  in  Figure  2.5. 

2.2.3  Attitude  and  Altitude  Estimation  System 

The  aircraft’s  position  and  orientation  were  provided  by  a  35  camera  VICON  MX  motion 
capture  system  at  the  Wright  Patterson  Air  Force  Base  (WPAFB)  Micro  Air  Vehicle  Integration 
Application  Research  Institute  (/lAVIARI)  where  the  flight  tests  were  performed.  The  VICON  MX 
motion  capture  system  is  a  commercial  off-the-shelf  package  that  used  multiple  cameras  to  locate 
small  reflective  markers  attached  to  the  airframe  of  the  helicopter.  The  cameras  are  calibrated  such 
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Video  Receiver 


Figure  2.5:  Video  hardware  used  at  the  ground  station  to  acquire  video  from  the  UAV  and  convert 
it  to  a  digital  signal  for  processing  on  the  ground  station  computer. 

that  the  position  of  each  camera  relative  to  the  other  cameras  observing  the  airframe  is  known. 
A  body  frame  coordinate  system  is  defined  in  software  using  the  reflective  markers.  Using  the 
location  of  these  reflective  markers  as  seen  from  the  multiple  cameras  and  the  known  locations  of 
each  of  the  VICON  cameras,  an  estimate  of  the  aircraft’s  attitude  and  position  can  be  calculated. 

The  estimates  of  the  aircraft’s  attitude  and  altitude  were  used  to  perform  the  autonomous 
vision-based  landings  as  described  in  Chapters  4  and  5.  The  x  and  y  positions  of  the  UAV  as 
derived  from  the  VICON  system  were  not  used  to  perform  the  vision-based  landings.  They  were, 
however,  used  in  the  control  of  the  helicopter  before  the  target  was  acquired  and  when  the  target 
was  not  found  in  the  image  frame. 

2.2.4  Ground  Station  Software 

The  aircraft  position  and  attitude  estimation,  and  the  aircraft  control  algorithms  were  run  on 
a  Boxx  3.4Ghz  workstation  computer.  The  control  algorithms  were  implemented  using  Lab  View 
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version  8.6  and  the  vision  processing  was  done  in  C++  using  the  OpenCV  computer  vision  library 

[19]. 
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CHAPTER  3.  AIRCRAFT  STABILIZATION,  ALTITUDE,  AND  NAVIGATION 
CONTROL 


This  chapter  details  the  controllers  used  to  orient  the  aircraft  at  a  commanded  attitude  and 
altitude.  Once  we  were  able  to  realize  commanded  orientations,  we  were  then  able  to  navigate  to 
desired  locations  by  commanding  a  desired  attitude  that  would  take  us  to  the  desired  location  by 
means  of  a  navigational  controller.  There  are  slight  differences  between  the  controllers  used  in 
simulation  and  the  controllers  used  in  hardware  for  reasons  explained  in  this  chapter,  though  the 
basic  architecture  remains  the  same.  Attitude,  altitude,  and  navigation  controllers  are  presented  in 
this  chapter  as  well  as  data  showing  the  response  of  the  aircraft  when  the  controllers  were  used  to 
track  a  desired  input  in  simulation  and  hardware  flight  testing. 

3.1  Attitude  Controller 

For  an  aircraft  to  maintain  steady  hover  flight,  it  must  be  able  to  hold  a  desired  attitude. 
Also,  to  navigate  to  desired  locations  and  stay  at  a  desired  location,  as  is  our  goal  with  vision-based 
landings,  the  attitude  controller  must  be  able  to  effectively  track  a  time-varying  desired  attitude. 
This  section  details  the  controller  used  to  orient  the  aircraft  at  a  time-varying  desired  attitude  so 
that  vision-based  landings  could  be  achieved. 

One  of  the  difficulties  of  working  with  tailsitter  aircraft  is  that  the  conventional  3-2-1  rota¬ 
tional  sequence  used  to  describe  an  aircraft’s  orientation  using  Euler  angles  proves  to  be  inadequate 
when  used  to  describe  the  orientation  of  tailsitter  aircraft.  This  is  because  the  Euler  angle  used  to 
describe  an  aircraft’s  pitch  in  the  3-2-1  rotation  sequence  exhibits  a  singularity  as  the  aircraft’s 
pitch  nears  an  angle  of  ±7t/2,  which  is  the  orientation  of  a  tailsitter  in  hover  flight.  For  this 
reason  quaternions  were  primarily  used  to  describe  vehicle  orientation  in  this  work.  A  thorough 
explanation  of  quaternions  as  rotation  operators  is  described  by  Kuipers  in  [20].  The  notation  for 
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quaternions  used  throughout  this  work  is  of  the  form 


T7(.)  =  usin(a/2)  +  cos(a/2)  = 


aq.)  sin(a/2) 

HiO) 

u2(.)  sin(a/2) 

«3(.)  sin(a/2) 

m-) 

cos  (a/2) 

.  ^(-)  . 

where  u  is  the  unit  axis  of  rotation  and  a  is  the  angle  rotated  about  u.  The  symbol  (•)  is  used 
to  denote  the  location  where  the  name  of  the  quaternion  is  specified,  (‘a’  represents  for  aircraft 
quaternion  which  is  the  attitude  of  the  aircraft  relative  to  an  inertial  coordinate  frame,  ‘d’  stands 
for  desired  quaternion  relative  to  an  inertial  coordinate  frame,  ‘e’  stands  error  quaternion  which 
is  the  error  between  the  aircraft  and  desired  quaternions  relative  to  the  aircraft’s  body  frame).  A 
more  thorough  explanation  of  the  different  quaternions  and  coordinate  frames  used  in  this  work  is 
presented  in  the  nomenclature  section  of  this  work.  It  is  assumed  that  the  tailsitter  aircraft  used  with 
the  method  described  in  this  paper  has  means  of  rotating  about  each  of  it’s  body  frame  principle 
axes  independently. 

3.1.1  Simulation  Attitude  Controller 

In  simulation,  attitude  control  was  performed  directly  on  the  error  quaternion  r\e  which  is 
the  quaternion  that  describes  the  error  between  the  aircraft  quaternion  Tja  and  the  desired  quaternion 
r\ci.  Proportional-integral-derivative  (PID)  control  was  used  to  determine  desired  actuator  positions 
which  were  then  sent  to  the  servos  to  actuate  the  control  surfaces. 

To  compute  the  error  quaternion,  we  consider  the  definition  of  the  desired  quaternion  as  de¬ 
scribed  in  [21].  The  desired  quaternion  is  described  mathematically  as  the  quaternion  composition 
of  the  error  quaternion  and  the  aircraft  quaternion  as  represented  by 

rid  =  Ve®Va  =  {Va}Rrie-  (3.1) 
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The  term  {r/(  )}^  denotes  the  quaternion  composed  matrix 


(r?(.)}^  = 


A4(, 

-773,) 

772,) 

% 

%) 

774,) 

-771,) 

771,) 

774(.) 

V3, 

-nin 

-V2(, 

-V3(, 

V4, 

(3.2) 


Using  the  property  {77}^{t7}fi  =  /4  (where  I4  is  the  four  by  four  identity  matrix)  we  can  solve 
Equation  3.1  for  r\e  yielding 


Ve  =  {VajfiVd- 


(3.3) 


Because  the  error  quaternion  is  a  direct  expression  of  the  error  in  the  orientation  of  the  aircraft, 
its  components  can  be  used  directly  to  compute  desired  control  surface  deflections.  PD  control 
was  applied  to  the  first  three  components  of  the  error  quaternion  to  compute  the  desired  control 
surfaces  deflections  as 


8a — kq\T]ie  kpP , 

(3.4) 

II 

.3 

to 

to 

1 

(3.5) 

8r  =  kn3r\3e  -  krr. 

(3.6) 

The  terms  kq\,  kq3,  and  kq 3  are  the  proportional  gains  while  kp,  kq,  and  kr  are  the  derivative  gains. 

3.1.2  Hardware  Attitude  Controller 

The  attitude  controller  used  in  flight  testing  was  very  similar  to  the  controller  used  in  sim¬ 
ulation  flight  tests.  The  main  difference  being  that  the  controller  used  in  hardware  flight  tests  was 
done  using  Euler  angles  instead  of  directly  in  quaternions.  This  was  done  as  the  flight  testing 
setup  used  at  the  Wright  Patterson  AFB  /iAVIARI  facilities  had  been  previously  programmed  us¬ 
ing  Euler  angles.  Also  note  that,  the  conversion  between  Euler  angles  and  quaternions  is  known  as 
outlined  in  [20]. 
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(a)  Block  diagram  showing  the  PID  pitch  controller  used  in  flight  testing 


Desired 

Roll 


(b)  Block  diagram  showing  the  PID  roll  controller  used  in  flight  testing 


Desired 

Yaw 


(c)  Block  diagram  showing  the  PID  yaw  controller  used  in  flight  testing 


Figure  3.1:  Block  diagrams  of  the  PID  attitude  controllers  used  in  flight  testing. 
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The  controller  used  in  hardware  flight  testing  used  PID  control  as  well  as  a  feedforward 
trim  term  as  can  be  seen  in  Figure  3.1.  This  trim  term  was  used  to  account  for  biases  in  the 
airframe  or  flying  conditions  and  was  set  by  the  operator  at  the  beginning  of  a  flight  to  a  value 
that  minimized  the  error  in  the  roll,  pitch,  and  yaw  terms.  After  the  initial  tuning  these  trim  terms 
remained  constant  throughout  the  remainder  of  the  flight. 

3.1.3  Attitude  Controller  Results 


Desired  r|1  vs.  Actual  r|1  from  Simulation 


Desired  r|2  vs.  Actual  r)2  from  Simulation 


(a)  Desired  77 1  and  actual  77 1  in  simulation. 


(b)  Desired  772  and  actual  772  in  simulation. 


Desired  t]3  vs.  Actual  r|3  from  Simulation 


Desired  t]4  vs.  Actual  t)4  from  Simulation 


(c)  Desired  773  and  actual  773  in  simulation. 


(d)  Desired  774  and  actual  774  in  simulation. 


Figure  3.2:  Comparison  of  desired  and  actual  attitude  states  from  simulation  flight  tests. 


Figure  3.2  shows  the  different  components  of  the  actual  and  desired  attitude  from  simulated 
flight  testing.  These  plots  show  the  simulation  controller’s  effectiveness  in  controlling  the  aircraft 
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Figure  3.3:  Error  between  the  aircraft’s  attitude  and  the  desired  attitude  in  hardware  flight  testing. 

to  a  desired  attitude.  Figure  3.3  shows  the  error  between  the  aircraft  attitude  and  the  desired  attitude 
for  the  flight  data  shown  in  Figure  3.2.  As  can  be  seen  in  the  plots,  the  attitude  error  stays  under 
1.5  degrees  and  settles  out  to  approximately  0.4  degrees.  The  attitude  error  does  not  approach  zero 
in  simulation  because  no  integral  term  was  used  in  the  simulation  attitude  controller. 

Figure  3.4  shows  a  comparison  of  the  actual  and  desired  Euler  angles  commanded  to  the 
helicopter  used  in  flight  testing.  The  helicopter  left  the  ground  in  hover  flight  at  about  6  seconds 
and  landed  at  approximately  97  seconds.  The  initial  error  in  the  t/r  angle  was  trimmed  out  by  the 
operator  by  about  35  seconds  into  the  flight  as  can  be  seen  in  3.4c.  Note  that  while  the  results 
shown  in  Figure  3.4  were  derived  from  flight  testing  using  a  helicopter,  the  pitch  angle  is  shown  as 
if  from  a  tailsitter  with  0  —  n/2  representing  the  helicopter  in  hover  flight  with  its  rotors  parallel 
to  the  ground.  The  roll  and  pitch  attitudes  exhibit  noticeable  oscillation.  This  is  potentially  due 
to  the  change  in  the  aircraft’s  center  of  gravity  that  occurred  when  the  onboard  video  equipment 
was  added  to  the  aircraft  after  the  attitude  controllers  had  been  tuned.  Figure  3.5  shows  the  error 
between  the  aircraft  attitude  and  the  desired  attitude  for  the  flight  test  shown  in  Figure  3.4.  As  can 
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(a)  Desired  pitch  and  actual  pitch  in  flight  testing 


(b)  Desired  roll  and  actual  roll  in  flight  testing 


Desired  vs.  Actual  -  ty 


(c)  Desired  yaw  and  actual  yaw  in  flight  testing 


Figure  3.4:  Block  diagrams  for  the  PID  attitude  controllers  used  in  flight  testing. 


be  seen  in  the  plot,  the  attitude  error  is  initially  high,  this  is  due  to  the  initial  error  in  the  yaw  angle 
that  is  trimmed  out  by  about  35  seconds  into  the  test.  There  is  large  error  at  the  end  the  plot  shown 
in  Figure  3.5,  this  is  because  the  aircraft  lands  at  94  seconds  at  an  attitude  that  is  not  the  desired 
attitude,  specifically  the  aircraft  lands  with  an  error  in  yaw.  Between  the  time  when  the  aircraft  is 
trimmed  (35  s)  and  when  the  aircraft  lands  (94  s)  the  aircraft  has  an  average  attitude  error  of  5.5 
degrees. 


3.2  Altitude  Controller 

A  responsive  altitude  controller  with  little  overshoot  is  needed  for  vision-based  landings. 
Because  so  much  more  energy  is  required  to  stay  in  hover  flight  than  level  flight,  time  spent  waiting 
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Figure  3.5:  Error  between  the  aircraft’s  attitude  and  the  desired  attitude  in  hardware  flight  testing. 


for  the  altitude  controller  to  reach  steady  state  can  greatly  decrease  flight  duration  and  therefore 
must  be  minimized.  Also,  any  overshoot  in  the  controller  when  descending  to  a  desired  altitude 
could  cause  the  UAV  to  land  prematurely.  For  these  reasons  an  altitude  controller  that  responds 
quickly  and  has  little  or  no  overshoot  is  desirable  for  the  task  of  precision  landings.  This  section 
describes  the  controller  used  for  altitude  control  as  well  as  the  results  from  using  the  altitude 
controller  in  simulation  and  hardware  flight  testing. 


3.2.1  Simulation  Altitude  Controller 

A  block  diagram  of  the  altitude  controller  used  in  simulation  can  be  seen  in  Figure  3.6.  The 
desired  altitude  shown  in  the  figure  is  the  altitude  of  the  user-defined  waypoint  or  the  altitude  of 
the  ground  target  when  the  vision-based  navigation  scheme  is  turned  on.  In  simulation,  the  force 
produced  by  the  motor-prop  combination  does  not  change  with  time  for  a  given  throttle  setting.  For 
this  reason,  no  integral  term  is  needed  in  the  simulation  altitude  controller  to  maintain  a  constant 


20 


Feedforward 

Throttle 

Setting 


Desired 

Altitude 


Figure  3.6:  Block  diagram  of  the  altitude  controller  used  in  simulation. 


altitude  over  a  period  of  time.  A  feedforward  throttle  setting  is  applied  to  the  control  so  that 
the  feedback  controller  operates  about  the  aircraft’s  hover  flight  throttle  setting.  This  allows  the 
controller  to  perform  more  smoothly,  especially  when  descending  to  a  desired  altitude.  To  prevent 
the  aircraft  from  descending  too  rapidly,  which  could  cause  overshoot  and  premature  landing  or 
crashing,  we  specified  a  maximum  descent  rate  for  the  aircraft.  When  the  vertical  decent  rate  of  the 
aircraft  was  greater  than  the  user  specified  maximum  descent  rate,  an  throttle  input  of  full  throttle 
was  applied  until  the  vertical  descent  rate  slowed  to  an  acceptable  value. 


3.2.2  Hardware  Altitude  Controller 

The  controller  used  in  hardware  flight  testing  was  very  similar  to  the  controller  used  to 
control  altitude  in  simulation.  As  can  be  seen  in  Figure  3.7,  the  main  difference  is  the  addition  of 
an  integral  term  in  the  controller  and  the  absence  of  a  vertical  descent  rate  saturation  block.  Unlike 
simulation,  the  throttle  setting  required  to  maintain  a  specific  altitude  for  an  aircraft  changes  with 
time  in  actual  flight  testing.  This  is  because  the  thrust  output  of  the  helicopter  is  proportional  to 
the  decreasing  battery  voltage.  For  this  reason,  integral  control  was  added  to  counteract  the  effects 
of  thrust  loss  due  to  decreases  in  battery  voltage. 

Analogous  to  the  feedforward  throttle  setting  in  the  simulation  controller,  a  throttle  trim 
setting  was  used  in  the  hardware  altitude  controller.  This  throttle  trim  setting  was  determined  by 
increasing  the  throttle  setting  until  the  aircraft  maintained  a  constant  desired  altitude.  The  throttle 
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Figure  3.7:  Block  diagram  of  the  altitude  controller  used  in  flight  testing. 


trim  setting  was  then  left  constant  for  the  remainder  of  the  flight.  The  throttle  trim  setting  was  reset 
at  the  beginning  of  each  flight. 

For  safety  reasons  the  desired  altitude  of  the  aircraft  was  set  by  the  operator  throughout  each 
flight  test.  This  was  to  prevent  damage  to  the  aircraft  that  could  have  occurred  through  premature 
landings  or  unexpected  behavior  in  the  calculation  of  a  computer  derived  desired  altitude. 


3.2.3  Altitude  Controller  Results 

The  response  of  the  altitude  controller  used  in  simulation  and  described  in  Section  3.2.1  is 
shown  in  Figure  3.8.  The  aircraft  started  at  ground  level  and  was  initially  commanded  to  5  meters 
AGL,  upon  reaching  5  meters  AGL  the  aircraft  was  commanded  to  10  meters  AGL.  After  reaching 
10  meters  AGL  the  aircraft  was  commanded  to  descend  back  to  ground  level.  Notice  that  the  slope 
of  the  aircraft’s  altitude  during  the  descent  phase  (40-140  seconds)  is  roughly  constant.  This  is  due 
to  the  descent  velocity  saturation  method  used  to  prevent  the  aircraft  from  becoming  uncontrollable 
by  descending  too  quickly. 

The  response  of  the  altitude  controller  used  in  flight  testing  described  in  Section  3.2.2  is 
shown  in  Figure  3.9.  The  helicopter  started  at  ground  level  with  a  desired  altitude  below  ground 
while  the  rotors  were  slowly  spun  up  to  some  initial  angular  velocity.  Once  the  helicopter  rotors 
were  spinning  the  desired  altitude  was  set  to  2  meters,  this  was  later  decreased  to  1.5,  1.0,  0.5 
meters,  and  a  negative  altitude  corresponding  to  an  desired  altitude  of  zero.  Because  the  desired 
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Actual  vs.  Desired  Altitude  in  Simulation 
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Figure  3.8:  Comparison  of  actual  and  desired  altitudes  in  simulation  using  the  controller  described 
in  Section  3.2.1. 

altitude  of  the  aircraft  was  controlled  by  the  operator,  as  opposed  to  an  algorithm,  no  descent 
velocity  saturation  techniques  were  needed.  As  shown  in  the  figure,  the  actual  altitude  of  the 
helicopter  closely  follows  the  desired  altitude  for  the  aircraft. 

3.3  Navigation  Controller 

The  navigation  controller  uses  the  current  states  of  the  UAV  and  the  desired  location  of  the 
UAV  to  determine  a  desired  orientation  of  the  aircraft  that  will  navigate  the  aircraft  to  the  desired 
location.  The  output  of  the  navigation  controller  is  used  as  the  input  to  the  attitude  controllers 
previously  described  in  this  chapter.  In  our  tests  we  were  not  concerned  with  the  heading  of  the 
aircraft  being  aligned  with  the  motion  vector  of  the  aircraft  in  the  North-East  plane.  For  this  reason 
the  desired  heading  of  the  aircraft  was  set  at  a  constant  of  zero  degrees  off  North  for  both  simulation 
and  flight  testing. 


n - r 


- Actual 

- Desired 
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Actual  vs.  Desired  Altitude  from  Flight  Testing 


time  (s) 


Figure  3.9:  Comparison  of  actual  and  desired  altitudes  from  flight  testing  using  the  controller 
described  in  Section  3.2.2. 

The  navigation  controller  used  in  simulation  is  detailed  by  Knoebel  et  al.  [5]  and  is  pre¬ 
sented  in  Appendix  A.  The  navigational  controller  used  in  hardware  is  similar  to  that  used  in 
simulation  and  is  presented  below  in  this  section.  The  results  of  each  controller’s  effectiveness  at 
navigating  the  helicopter  to  a  desired  location  is  also  presented. 

3.3.1  Hardware  Navigation  Controller 

Figures  3.10  and  3.11  show  the  navigation  controller  used  to  navigate  the  aircraft  from  its 
current  location  to  a  desired  location.  The  hardware  navigation  controller  differs  from  the  naviga¬ 
tion  controller  used  in  simulation  in  that  it  is  performed  using  Euler  angles  instead  of  quaternions 
for  reasons  explained  in  section  3.1.2.  The  blocks  labeled  ‘Pitch  Controller’  and  ‘Roll  Controller’ 
represent  the  block  diagrams  shown  in  Figures  3.1a  and  3.1b  respectively. 

In  Figures  3.10  and  3.11,  the  x  and  y  directions  are  the  x  and  y  directions  in  the  helicopter 
body  frame  with  the  x-axis  pointing  out  the  nose  of  the  helicopter,  the  y-axis  pointing  out  the  right 
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Figure  3.10:  Block  diagram  of  the  navigation  x  direction  controller  used  in  flight  testing. 


Figure  3.11:  Block  diagram  of  the  navigation  y  direction  controller  used  in  flight  testing. 


side  of  the  helicopter,  and  the  7- ax  is  pointing  out  the  bottom  of  the  helicopter.  These  x  and  y 
directions  in  the  helicopter  body  frame  correspond  to  the  z  and  y  directions  in  the  tailsitter  body 
frame,  respectively,  for  a  tailsitter  in  hover  flight. 

Operator  specified  waypoints  were  used  to  specify  the  desired  position  of  the  UAV  if  the 
ground  target  was  not  present  in  the  image  frame.  When  the  ground  target  was  detected  in  the 
image  frame  the  estimated  location  of  the  UAV  from  vision  was  used  to  navigate  the  UAV  onto 
the  centroid  of  the  target.  The  location  of  this  desired  position  in  the  inertial  frame  was  then 
determined  in  the  aircraft’s  body  frame  as 
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body 
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error 


(3.7) 


where  [x  y  z\lody  is  the  aircraft  position  error  in  the  helicopter  body  reference  frame,  [x  y  z\{rror 
is  the  error  between  the  desired  location  and  the  actual  aircraft  location  in  the  inertial  reference 
frame,  and  Rhv  is  the  rotation  matrix  between  the  vehicle  coordinate  system  and  the  body  coordinate 
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system.  Using  the  3-2-1  aerospace  rotation  sequence  [20]  the  rotation  from  the  vehicle  frame  to 
the  body  frame  is  given  by 


cos  i/a cos  0  sint/A  cos  0  —sin  0 

cos  t/Asin0  sin  0 —  sint/A cos  0  sin  t/A  sin  0  sin  0  +  cos  t/Acos0  cos0sin0 
cos  t/A  sin  0  cos  (j)  +  sint/A  sin  (j)  sin  t/A  sin  0  cos  (j)  —  cos  i/a  sin  (j)  cos  0  cos  0 


(3.8) 


An  alternate  definition  of  the  transpose  of  the  matrix  in  Equation  3.8  is  given  in  Chapter  4  as 
Equation  4.1  which  uses  quaternions  to  define  the  matrix.  There  is  no  difference  between  the 
matrix  defined  in  Equation  3.8  and  the  transpose  of  the  matrix  defined  in  Equation  4.1  besides  the 
fact  that  the  former  is  defined  using  Euler  angles  and  the  latter  is  defined  using  quaternions.  The 
two  matrices  yield  the  same  direction  cosine  matrix. 


3.3.2  Navigation  Controller  Results 


time  (s) 

(a)  Comparison  of  the  desired  and  actual  x  location  of 
the  aircraft  in  simulation. 
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(b)  Comparison  of  the  desired  and  actual  y  location  of 
the  aircraft  in  simulation. 


Figure  3.12:  Desired  and  actual  location  of  the  aircraft  in  simulation. 


To  show  the  effectiveness  of  the  navigational  controller  used  in  simulation,  the  simulated 
aircraft  was  commanded  to  fly  waypoints  that  outlined  a  20  meter  wide  square  in  the  North-East 
plane.  The  results  of  following  these  waypoints  are  presented  in  Figure  3.12.  The  navigational 
controller  exhibits  a  rise  time  of  16.2  seconds  to  move  20  meters  to  the  next  desired  waypoint.  The 
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controller  also  exhibits  8  percent  of  overshoot  after  having  reached  the  desired  location.  As  Figure 
3.12  demonstrates,  the  navigational  controller  described  in  this  chapter  is  capable  of  tracking  a 
desired  input  in  simulation.  This  task  of  tracking  a  desired  position  is  essential  to  vision-based 
landings  of  VTOL  aircraft. 


(a)  Comparison  of  the  desired  and  actual  x  location  of  (b)  Comparison  of  the  desired  and  actual  y  location  of 

the  aircraft  from  flight  testing.  the  aircraft  from  flight  testing. 

Figure  3.13:  Desired  and  actual  location  of  the  aircraft  from  flight  testing. 


Figure  3.13  shows  the  navigational  controller’s  effectiveness  at  tracking  a  reference  input. 
Figure  3.13  shows  the  data  from  a  flight  test  where  the  aircraft  was  initially  commanded  to  fly  in 
a  straight  line  forwards  and  backwards  corresponding  to  the  time  from  40  to  120  seconds,  after 
which  the  aircraft  was  commanded  to  fly  in  a  circular  pattern  corresponding  to  the  time  from  120 
to  215  seconds.  The  controller  exhibits  a  rise  time  of  3.1  seconds  for  a  step  input  of  1  meter  with 
no  overshoot.  There  was  an  average  position  error  of  8  centimeters  after  the  aircraft  had  reached  a 
constant  desired  input  for  the  flight  shown  in  Figure  3.13.  The  navigational  controller  results  show 
that  accuracy  in  our  flight  testing  setup  has  a  lower  bound  of  approximately  8  centimeters.  This  is 
still  well  within  the  sub-meter  goal  that  we  have  for  this  vision-based  method. 
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CHAPTER  4.  RELATIVE  POSITION  ESTIMATION 


For  a  VTOL  UAV  to  land  on  a  visually  detected  target,  some  information  regarding  its 
position  relative  to  the  landing  sight  must  be  known.  Using  the  pixel  location  of  the  target  in  the 
image  and  the  aircraft’s  orientation  relative  to  some  inertial  frame,  a  vector  pointing  from  the  UAV 
to  the  target  centroid  can  be  calculated  by  rotating  between  the  different  reference  frames  that  are 
described  in  the  next  section.  Using  the  altitude  AGL  of  the  aircraft,  the  vector  pointing  towards 
the  target  centroid  can  be  scaled  such  that  the  aircraft’s  position  relative  to  the  target  is  known 
in  the  North  and  East  directions.  This  chapter  introduces  the  coordinate  frames  used  to  perform 
these  calculations  which  is  followed  by  a  brief  description  of  the  pinhole  camera  model.  We  also 
introduce  the  method  used  to  detect  the  target  in  the  image  frame  and  the  computation  of  the  image 
centroid  used  for  navigation.  Finally,  the  mathematics  behind  computing  the  relative  position  of 
the  UAV  is  presented  followed  by  our  simulation  and  hardware  results. 

4.1  Coordinate  Frames 

Several  different  coordinate  frames  are  used  to  determine  the  relative  position  of  the  UAV 
to  a  ground  target.  The  inertial  frame  is  located  at  a  user-defined  home  location  with  its  jt-axis 
pointing  North,  its  y-axis  pointing  East,  and  its  z-axis  pointing  into  the  ground,  forming  a  right- 
handed  coordinate  system.  The  target  frame  axes  point  in  the  same  directions  as  the  inertial  frame 
but  with  its  origin  located  at  the  center  of  the  ground  target  of  interest.  The  vehicle  frame  is  also 
aligned  with  the  inertial  frame  with  its  origin  at  the  UAV’s  center  of  gravity.  The  inertial  frame,  the 
target  frame,  and  the  vehicle  frame  are  all  shown  in  Figure  4.1.  The  body  frame  shares  its  origin 
with  the  vehicle  frame  with  the  v-axis  pointing  out  the  nose  of  the  aircraft,  the  y-axis  pointing  out 
the  right  wing,  and  the  7-axis  pointing  out  the  belly  of  the  aircraft,  also  forming  a  right  handed 
coordinate  system.  The  body  frame  of  a  tailsitter  aircraft  is  shown  in  Figure  4.2a 
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Figure  4.1:  Inertial  based  reference  frames. 


(a)  Body  based  reference  frames. 


(b)  Gimball  frame  and  az-  (c)  Gimbal2  frame  and  ele- 
imuth  angle.  vation  angle 


Figure  4.2:  Several  different  reference  frames  used  in  the  relative  position  estimation  are  described. 


Despite  the  fact  that  no  gimbal  is  used  to  point  the  fixed  onboard  camera,  we  still  denote 
several  gimbal-based  frames  for  ease  in  defining  the  orientation  of  the  camera  and  to  be  consistent 
with  the  work  of  predecessors  [22].  The  gimbal  frame  has  an  origin  located  at  the  center  of  the 
camera  with  axes  aligned  with  the  body  frame  axes.  The  gimbal- 1  frame  is  the  gimbal  frame 
rotated  by  the  azimuth  angle,  (ocaz),  about  the  gimbal  frame  z-axis.  The  gimbal-2  frame  is  the 
gimbal- 1  frame  rotated  by  the  angle  aei  about  the  negative  gimbal- 1  frame  v-axis.  The  camera 
frame  has  an  origin  located  at  the  center  of  the  camera  sensor  with  the  x-axis  pointing  out  the 
right  of  the  camera  from  the  perspective  of  looking  through  the  camera,  the  y-axis  pointing  out 
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the  bottom  of  the  camera,  and  the  z-axis  pointing  out  the  lens  of  the  camera.  Each  of  the  gimbal 
coordinate  frames  and  the  camera  frame  are  shown  in  Figure  4.2.  The  rotation  and  transformation 
matrices  described  in  the  nomenclature  section  of  this  work  are  used  to  rotate  between  these  frames 
as  described  in  later  in  this  section  and  in  Section  4.4. 

4.2  Pinhole  Camera  Model 

The  pinhole  camera  model  describes  the  mathematical  relationship  between  a  point  in 
three-dimensional  space  and  its  projection  onto  the  two-dimensional  image  plane  of  an  ideal  pin¬ 
hole  camera.  As  can  be  seen  in  Figure  4.3,  a  three-dimensional  point  is  projected  onto  an  imaginary 
plane  at  a  distance  of  one  focal  length  from  the  camera.  Points  on  this  image  plane  are  described 
using  the  two-dimensional  image  reference  frame  whose  origin  we  have  defined  at  the  top  left-hand 
side  of  the  image  and  whose  .r-axis  points  out  the  right  of  the  image  and  whose  y-axis  points  out  the 
bottom  of  the  image  as  shown  in  Figure  4.3.  The  image  reference  frame  uses  units  of  pixels  to  de¬ 
scribe  the  location  of  a  point  on  the  image  plane.  The  transformation  between  the  image  frame  and 
the  camera  frame  is  made  possible  with  the  camera  calibration  matrix  K,  which  describes  some 
of  the  intrinsic  parameters  of  the  camera.  The  parameters  fx,  fy,  cx,  and  cy  are  obtained  from  a 
camera  calibration  as  is  performed  by  the  Matlab  camera  calibration  toolbox  or  using  the  OpenCY 
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camera  calibration  example.  The  terms  cx  and  cy  are  the  x  and  y  translations  needed  to  move  the 
image  frame  origin  at  the  upper  right  of  the  image,  to  the  camera  frame  origin  at  the  center  of  the 
image.  The  parameters  fx  and  fy  are  the  conversions  from  pixels  to  meters  in  the  x  and  y  directions 
applied  at  one  focal  length  from  the  camera  in  the  camera  frame  z  direction  If  the  camera  pixels 
are  perfectly  square,  then/*  and  fy  are  the  same  value.  The  conversion  from  the  image  coordinate 
frame  to  the  camera  coordinate  frame  is  given  by 
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This  does  not  however  give  the  actual  location  of  the  point  of  interest  in  three-dimensional  space 
but  rather  the  location  of  that  point  projected  onto  the  image  plane  at  a  distance  of  one  focal  length 
from  the  camera.  Because  the  location  of  the  point  of  interest  has  been  reduced  from  3-dimensions 
to  2-dimensions  when  the  scene  is  captured  by  the  camera,  the  location  of  the  point  of  interest  is 
only  determined  up  to  an  unknown  scale.  In  essence  we  only  know  a  vector  pointing  from  the 
camera  to  the  object  but  we  don’t  know  the  length  of  that  vector.  The  method  of  determining  the 
actual  three-dimensional  location  of  a  point  in  space  is  shown  in  Section  4.4  of  this  chapter  and 
requires  the  use  of  information  such  as  the  distance  to  the  target  to  resolve  this  unknown  scale. 

4.3  Target  Detection 

Vision-based  landings  are  dependent  on  the  ability  to  autonomously  detect  and  track  a  tar¬ 
get  in  video  streamed  from  a  UAV.  Many  different  methods  exist  for  automatic  target  recognition, 
the  more  complex  of  which  are  beyond  the  scope  of  this  work.  Automatic  target  recognition  re¬ 
mains  an  open  research  topic  with  several  working  solutions  that  fit  different  needs.  In  this  work, 
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we  utilize  a  target  detection  algorithm  that  can  determine  the  pixel  coordinates  of  the  centroid  of  a 
target  in  the  image  frame. 

The  method  used  in  this  work  to  determine  the  centroid  of  a  ground  target  of  interest  was 
simple  color  segmentation  for  the  color  red  in  simulation  and  simple  thresholding  of  a  black  and 
white  image  in  hardware  testing.  These  methods  are  demonstrate  the  vision-guided  landing  con¬ 
cepts  in  this  work. 

4.3.1  Color  Segmentation 

To  detect  the  target  using  color  segmentation,  the  image  sent  from  the  onboard  camera 
was  first  converted  to  the  hue,  saturation,  value  (HSV)  color  space.  The  image  space  was  then 
searched  for  colors  that  fit  between  a  window  of  hue  and  saturation  values.  This  is  represented 
mathematically  as 

p  (  1 5  if  H mm  <  H{  j  <  //max  &  •''min  <  Sjj  <  iS'max 

I  0,  otherwise 

where  Pjj  is  the  value  of  the  binary  segmented  image  at  pixel  location  (/./),  Hjj  is  the  hue  value  of 
the  original  image  at  location  (ij),  and  Sj  j  is  the  saturation  value  of  the  original  image  at  location 
(ij).  //max  and  Hm\n  define  the  window  of  acceptable  hue  values  that  classify  the  color  of  interest 
while  the  terms  Smax  and  ,Smm  define  the  window  of  acceptable  saturation  values  for  the  color  of 
interest.  The  advantage  of  using  the  HSV  color  space  over  the  red-green-blue  (RGB)  or  other 
standard  color  spaces  is  that  color  segmentation  in  the  HSV  color  space  is  more  robust  to  changes 
in  lighting  conditions.  An  example  of  color  segmentation  for  the  color  red  can  be  seen  in  the 
Aviones  simulation  images  shown  in  Figure  2.1.  The  center  image  in  Figure  2.1  shows  the  view 
from  the  onboard  camera  while  the  image  to  the  right  shows  the  image  received  from  the  onboard 
camera  after  having  been  segmented  for  the  color  red. 

4.3.2  Connected  Components 

Once  the  color  segmentation  or  thresholding  has  been  performed  yielding  a  binary  image, 
we  group  pixels  that  meet  the  segmentation/thresholding  conditions  into  connected  components. 
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Figure  4.4:  Connected  components  of  a  thresholded  image. 


Each  connected  region  of  pixels  that  fit  into  the  window  of  acceptable  colors  or  light  intensity  is 
labeled  as  a  unique  connected  component.  The  8-neighborhood  connected  component  algorithm 
used  in  this  research  was  done  using  the  CvContours  function  of  OpenCV,  the  documentation  for 
CvContours  is  provided  in  [19].  The  basic  methodology  of  the  8-neighborhood  connected  compo¬ 
nent  algorithm  is  described  in  [23]  as  Algorithm  8.1.  Figure  4.4  shows  a  visual  representation  of 
what  the  connected  components  algorithm  does.  The  left  most  image  in  the  figure  shows  a  black 
and  white  image  analogous  to  an  image  coming  from  a  camera  onboard  a  UAV.  The  middle  image 
is  the  original  image  thresholded  to  only  show  lighter  colored  objects.  The  right  image  is  colored 
such  that  each  connected  component  is  a  unique  color.  Note  that  the  spoon  in  the  images  in  Figure 
4.4  did  not  threshold  as  a  single  entity  and  therefore  was  composed  of  several  different  connected 
components. 

If  the  largest  connected  component  in  the  image  received  from  the  UAV  is  larger  than 
a  user-defined  threshold,  then  the  target  is  assumed  found  and  the  center  of  mass  of  the  largest 
connected  component  is  used  for  navigation.  This  method  of  using  segmentation  or  thresholding 
to  find  the  ground  target  of  interest  assumes  that  no  other  objects  in  the  image  have  the  same 
properties  as  the  target.  In  other  words,  we  are  searching  for  a  red  target  at  a  location  void  of  any 
red  objects  except  for  the  target. 
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4.3.3  Centroid  Computation 


The  A'  and  y  centroids  of  the  largest  connected  component  is  calculated  as 
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where  k  is  the  number  of  pixels  that  makes  up  the  largest  connected  component  and  a,-  and  v,  are  the 
x  and  y  pixel  coordinates  of  the  ith  components  of  the  largest  connected  component  in  the  image 
frame.  The  term  Acc  is  the  area  of  the  largest  connected  component  in  units  of  pixels;  this  is  also 
the  number  of  pixels  that  composes  the  largest  connected  component. 

4.4  Coordinate  Transformations 

With  the  pixel  coordinates  of  the  centroid  of  the  target  and  the  UAV’s  altitude  AGL  and  ori¬ 
entation  information,  the  relative  position  of  the  UAV  to  the  target  in  the  target  frame  is  calculated 
as 
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In  these  equations,  [vi  V2  V3]7'  is  a  vector  that  points  to  the  target  centroid  from  the  camera  frame 
origin  and  7  is  a  scaling  factor  that  represents  the  distance  from  the  camera  frame  origin  to  the 
target  centroid.  The  rotation  and  transformation  matrices  used  above  are  defined  as 


1  2T7fa—  l+2T7fa  2T7iaT72a  +  2T73aT74a  2r7iaT73a  — 2r72aT?4a  ^ 
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Because  the  above  rotation  matrices  are  orthonormal  (with  the  exception  of  K ),  the  following 
property  holds: 


where  fi  and  f2  simply  serve  as  placeholders  for  the  previously  defined  reference  frames. 


4.5  Results 

This  position  estimation  method  was  tested  in  the  simulation  environment  and  using  the 
hardware  setup  described  in  Chapter  2.  This  section  presents  the  findings  of  this  method  from 
simulation  and  hardware  testing. 

In  both  simulation  and  hardware  flight  testing  the  VTOL  UAV  started  at  ground  level  and 
used  truth  position  and  orientation  information  to  ascend  in  altitude  until  the  ground  target  came 
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Figure  4.5:  Flight  path  used  in  simulation  and  hardware  flight  testing. 


into  the  onboard  camera’s  view.  Once  the  ground  target  came  into  view  the  vision-based  relative 
position  estimation  method  described  in  this  chapter  was  used  to  navigate  the  UAV  over  the  ground 
target.  Figure  4.5  shows  the  different  phases  of  the  test  flights  used  to  validate  this  research.  The 
UAV  uses  truth  data  to  navigate  from  points  1  to  2  shown  in  the  figure.  Point  2  is  at  an  altitude 
such  that  the  ground  target  is  visible  to  the  onboard  camera.  From  point  2  to  point  4  vision  is  used 
to  estimate  the  UAV  position  relative  to  the  target. 

4.5.1  Position  Estimation  Simulation  Results 

Figure  4.6  shows  the  results  of  the  vision-based  position  estimation  algorithm  compared  to 
the  actual  position  of  the  UAV  in  simulation.  Since  the  position  estimation  algorithm  proposed  in 
this  chapter  gives  the  position  of  the  UAV  relative  to  the  centroid  of  the  ground  target,  the  location 
of  the  centroid  of  the  ground  target  in  the  inertial  frame  was  used  in  comparing  the  data  represented 
in  Figure  4.6. 
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(a)  Comparison  of  the  north  position  estimate 
from  vision  of  the  UAV  and  the  actual  north  po¬ 
sition  in  simulation. 


(b)  Comparison  of  the  east  position  estimate  from 
vision  of  the  UAV  and  the  actual  east  position  in 
simulation. 


(c)  Estimation  error  of  the  vision-based  position 
estimation  method  in  simulation. 

Figure  4.6:  Simulation  results  of  the  vision-based  relative  position  estimation  algorithm. 


As  can  be  seen  from  Figure  4.6c,  the  estimation  error  between  the  estimated  position  of  the 
UAV  and  the  actual  position  of  the  UAV  starts  out  at  approximately  2  meters  for  the  given  run  and 
then  quickly  approaches  zero.  This  initial  error  is  attributed  to  the  centroid  being  located  at  the 
edge  of  the  viewable  region.  As  the  centroid  moves  closer  to  the  center  of  the  image  the  position 
estimation  becomes  more  accurate.  Once  the  UAV  positions  itself  above  the  target  the  estimation 
error  drops  to  under  8  cm  from  an  altitude  of  10  meters. 
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(a)  Comparison  of  the  north  position  estimate 
from  vision  of  the  UAV  and  the  actual  north  po¬ 
sition. 


(b)  Comparison  of  the  east  position  estimate  from 
vision  of  the  UAV  and  the  actual  east  position. 


(c)  Estimation  error  of  the  vision-based  position 
estimation  method 

Figure  4.7:  Hardware  results  of  the  vision-based  relative  position  estimation  algorithm. 

4.5.2  Position  Estimation  Hardware  Results 

Figure  4.7  shows  the  position  estimation  results  from  hardware  flight  testing  using  the 
helicopter  platform  described  in  Section  2.2.  For  the  flight  test,  the  helicopter  started  behind  the 
target  at  an  altitude  of  2  meters  with  the  target  in  the  UAV’s  camera  view.  The  location  of  the 
ground  target  in  the  image  frame  and  information  about  the  aircraft’s  attitude  and  altitude  were  then 
used  to  calculate  a  relative  position  between  the  helicopter  and  the  target.  This  relative  position 
information  was  then  supplied  to  the  navigational  controller  described  in  Section  3.3  and  used 
to  position  the  helicopter  over  the  target.  The  helicopter  was  then  commanded  to  descend  to 
altitudes  of  1 .5,  1 .0,  and  0.5  meters  while  still  keeping  the  target  in  view  using  the  method  described 
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in  Chapter  5.  The  position  of  the  UAV  estimated  from  the  VICON  motion  capture  system  is 
used  as  the  truth  data  in  the  plots  shown  in  Figure  4.7  and  has  an  accuracy  of  approximately  two 
millimeters. 

Table  4. 1  shows  the  relative  position  estimation  results  from  the  ten  different  flight  tests 
that  were  performed  to  test  the  methods  described  in  this  work.  The  time  column  in  the  table  is 
the  cumulative  time  that  the  target  was  present  in  the  image  frame  in  order  for  a  position  estimate 
to  be  made.  Position  estimates  were  made  for  a  cumulative  flight  time  of  over  26  minutes  with 
an  average  position  error  of  22  centimeters.  The  table  also  presents  the  maximum  error  calculated 
for  each  test  flight  with  a  maximum  error  over  all  test  flights  being  1.17  meters.  The  variability  in 
these  maximum  errors  can  be  attributed  to  two  leading  factors,  primarily,  measurement  noise  in  the 
VICON  system  and  false  target  identifications.  The  VICON  MX  motion  capture  system  used  for 
attitude  and  altitude  measurements  was  typically  calibrated  once  in  the  day  before  a  series  of  flight 
tests.  An  increase  in  the  measurement  noise  was  noticed  as  the  time  since  a  calibration  increased. 
This  was  attributed  to  vehicles  passing  nearby  or  inside  the  /lAVIARI  facilities  and  due  to  the 
pressure  change  of  repeatedly  opening  and  closing  the  flight  facility  doors  causing  a  ballooning 
effect  inside  the  small,  sheet-metal  lined  room. 

Because  the  VICON  cameras  were  mounted  to  the  structure  of  the  flight  facility  walls,  any 
vibration  applied  to  the  structure  would  potentially  change  the  pose  of  the  cameras.  Each  camera’s 
pose  had  been  calculated  during  the  calibration  process  and  assumed  constant  thereafter  so  any 
change  in  the  camera’s  pose  after  the  calibration  was  complete  would  add  additional  error  to  the 
aircraft  position  and  attitude  estimates.  By  observing  the  attitude  estimate  of  the  aircraft  calculated 
from  the  VICON  system  when  the  aircraft  was  at  rest,  we  estimated  that  the  mean  attitude  noise 
from  the  VICON  system  was  approximately  0.0119  degrees.  However,  attitude  errors  as  high  as  1 
degree  were  observed.  A  1  degree  error  in  attitude  at  an  altitude  of  2  meters  would  yield  a  position 
error  of  approximately  4  centimeters.  The  second  source  of  error  came  about  because  objects 
in  the  camera  view  frustrum  would  appear  to  have  a  light  intensity  value  similar  to  that  of  the 
target.  Therefore  objects  other  than  the  target  could  be  mistaken  for  the  target  and  used  for  relative 
position  estimation.  It  is  easy  to  see  how  this  could  lead  to  large  position  estimation  errors.  Dull 
black  cloth  was  taped  to  the  floor  with  black  gaffing  tape  in  an  attempt  to  prevent  this  occurrence 
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and  more  complex  target  recognition  techniques  or  heuristic  methods  could  be  used  in  future  tests 
to  prevent  this  from  occurring. 


Table  4.1:  Relative  position  estimation  flight  results 


Flight  Test 

max  error  (m) 

min  error  (m) 

mean  error  (m) 

standard  deviation  (m) 

time  (s) 

1 

0.6035 

0.0063 

0.1680 

0.1424 

143.25 

2 

0.5997 

0.0162 

0.1470 

0.1892 

156.10 

3 

0.5603 

0.0175 

0.1680 

0.1780 

92.55 

4 

0.5780 

0.0038 

0.2290 

0.1987 

137.30 

5 

1.1680 

0.0020 

0.2517 

0.1020 

129.30 

6 

0.4174 

0.0100 

0.2209 

0.0998 

133.05 

7 

0.9599 

0.0334 

0.2799 

0.0817 

158.25 

8 

0.7568 

0.0108 

0.3275 

0.0974 

269.15 

9 

0.4908 

0.0023 

0.1728 

0.1314 

135.50 

10 

0.4956 

0.0099 

0.2423 

0.2065 

224.30 
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CHAPTER  5.  DESIRED  ATTITUDE  SATURATION 


With  an  estimate  of  the  UAV’s  position  relative  to  the  target,  the  next  step  becomes  moving 
to  the  target  while  still  keeping  the  target  in  view.  To  do  this,  a  desired  attitude  is  calculated  that 
will  take  the  UAV  from  its  current  location  to  the  desired  waypoint  using  the  method  described 
in  Chapter  3.  Given  the  current  location  of  the  UAV,  the  desired  location  of  the  UAV,  the  x  and 
y  body-frame  velocities,  and  the  roll,  pitch,  and  yaw  rates,  the  method  discussed  in  Section  3.3 
computes  a  desired  quaternion  that  will  navigate  the  UAV  to  the  desired  location.  This  chapter 
details  the  method  used  to  determine  a  saturation  limit  that  is  applied  to  the  desired  attitude  so  that 
the  ground  target  remains  in  view  at  all  times. 

To  some  extent  the  problem  that  the  ground  target  is  no  longer  visible  when  the  VTOL  UAV 
tilts  to  move  towards  the  target  is  a  self-correcting  problem.  Because  the  aircraft  tilts  in  a  way  that 
will  position  the  UAV  over  the  target  when  the  target  goes  out  of  view,  the  target  is  likely  to  come 
back  into  view  soon  after  the  target  leaves  the  image  frame.  However,  since  the  relative  position 
estimation  of  the  UAV  is  dependent  on  the  ground  target  being  in  the  image  frame,  it  is  important 
that  the  ground  target  remain  in  the  image  frame  so  that  the  UAV’s  position  can  be  calculated. 
Additionally,  the  UAV  mission  objectives  may  require  that  the  ground  target  of  interest  remain  in 
view  at  all  times  such  as  in  an  intelligence,  surveillance,  and  reconnaissance  (ISR)  scenario.  Also, 
as  the  following  example  demonstrates,  the  image-attitude  correlation  problem  is  not  always  self 
correcting. 

As  a  motivating  example  we  consider  a  GPS-denied  environment  with  a  0.2  meter/second 
cross  wind  coming  from  the  west.  The  UAV  is  initialized  at  an  altitude  of  five  meters  with  the  target 
in  the  right-hand  side  of  the  image  frame.  We  also  make  a  reasonable  assumption  that  the  automatic 
target  recognition  algorithm  requires  one  second  to  acquire  the  target  after  which  tracking  is  done 
with  no  added  lag,  each  time  the  target  goes  out  of  the  image  frame  it  takes  another  full  second 
to  reacquire  the  ground  target  in  the  image  frame.  When  no  saturation  is  applied  to  the  desired 
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attitude,  the  UAV  is  not  able  to  keep  the  target  in  view  and  the  UAV  ascends  to  reacquire  the 
target,  the  target  centroid  in  the  image  coordinate  frame  is  shown  in  Figure  5.1a.  While  the  target 
does  reappear  in  the  image  frame  for  short  periods  of  time,  the  0.2  meter/second  wind  pushes  the 
UAV  away  from  the  target  and  prevents  the  target  from  appearing  in  the  image  frame  for  longer 
than  one  second  segments.  In  this  scenario  the  UAV  never  reacquires  the  target  once  it  is  initially 
found  and  simply  ascends  indefinitely  in  search  of  the  ground  target.  The  position  of  the  UAV 
can  be  seen  constantly  ascending  in  this  simulated  flight  test  in  Figure  5.2a.  When  saturation  is 
applied  to  the  desired  attitude  of  the  UAV,  the  aircraft  initially  finds  the  ground  target  and  the  UAV 
moves  in  a  way  that  keeps  the  ground  target  in  view  until  an  altitude  of  0.5  meters  is  reached.  The 
ground  target  centroid  in  the  image  frame  can  be  seen  in  Figure  5.1b  until  the  the  UAV  reaches  an 
altitude  of  0.5  meters.  At  0.5  meters  above  the  target,  the  ground  target  is  no  longer  visible  from 
the  onboard  camera  due  to  the  attitude  that  the  aircraft  is  required  to  maintain  to  counter  the  effect 
of  wind.  The  position  of  the  UAV  as  it  performs  its  vision-based  landing  in  this  flight  test  can  be 
seen  in  Figure  5.2b.  This  example  demonstrates  a  scenario  when  the  desired  attitude  saturation 
technique  presented  in  this  chapter  is  required  for  precision  landings.  The  absence  of  the  desired 
attitude  saturation  method  in  this  scenario  leads  to  an  ever  ascending  UAV  that  is  unable  to  acquire 
the  ground  target  of  interest  and  therefore,  is  unable  to  estimate  its  own  position. 


(a)  Location  of  the  ground  target  centroid  in  the 
image  frame  for  a  simulated  test  flight  when  no 
desired  attitude  saturation  is  applied. 


(b)  Location  of  the  ground  target  centroid  in  the 
image  frame  for  a  simulated  test  flight  when  de¬ 
sired  attitude  saturation  is  applied. 


Figure  5.1:  The  target  centroid  in  the  image  frame  in  a  motivating  example  showing  the  need  for 
desired  attitude  saturation,  the  rectangle  defines  the  onboard  camera’s  view. 
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30. 


(a)  Flight  path  of  the  UAV  for  a  simulated  test  (b)  Flight  path  of  the  UAV  for  a  simulated  test 

flight  when  no  desired  attitude  saturation  is  ap-  flight  when  desired  attitude  saturation  is  applied, 

plied. 

Figure  5.2:  The  UAV  position  in  a  motivating  example  showing  the  need  for  desired  attitude  satu¬ 
ration. 


5.1  Desired  Attitude  Saturation  in  Quaternions 

With  the  desired  quaternion  known,  the  next  step  becomes  ensuring  that  the  orientation 
of  the  aircraft  at  the  desired  quaternion  will  still  allow  the  camera  to  view  the  ground  target.  We 
do  this  by  saturating  the  error  quaternion.  The  error  quaternion  is  the  error  between  the  aircraft 
orientation  quaternion  and  the  desired  quaternion,  or  in  other  words,  the  error  quaternion  rotates 
the  aircraft  from  its  current  attitude  to  the  desired  attitude.  The  error  quaternion  is  calculated  as 


terror  — 


t74at7ld  +  V3aV2d  +  t?2at?3d  ~  QlaQ4d 
—  t?3at7ld  +  fi4afi2d  ~  ^?laQ3d  “  t?2at?4d 
Mid  +  VlaV2d  +  M3d  ~  T?3afi4d 
QlaQld  +  t?2at?2d  +  t?3aT73d  +  T74afi4d 


and  is  defined  in  the  body  coordinate  frame. 

If  the  UAV  is  allowed  to  rotate  by  the  error  quaternion  to  the  previously  calculated  desired 
quaternion,  it  is  possible  for  the  UAV  to  rotate  in  a  manner  that  will  cause  the  target  to  go  out  of 
view  of  the  onboard  camera.  For  this  reason,  the  error  quaternion  is  saturated  so  that  the  rotation 
commanded  to  position  the  UAV  at  its  desired  location,  does  not  send  the  target  out  of  the  camera 
view.  A  quaternion  can  be  thought  of  as  a  representation  of  a  single  rotation  about  a  single  axis  of 


45 


Figure  5.3:  This  figure  shows  the  angle  amax,  the  axis  of  rotation  u  in  the  image  plane,  and  the 
view  frustum  of  a  tailsitter  in  hover  flight. 

rotation,  u,  by  an  angle  a.  We  then  calculate  the  maximum  allowable  angle,  amax  before  the  target 
centroid  goes  out  of  view  as  shown  in  Figure  5.3.  The  error  quaternion  is  then  recalculated  using 
this  oCmax  and  the  original  u,  so  that  the  resulting  rotation  does  not  move  the  target  outside  of  the 
camera  viewing  area. 

The  vector  component  of  the  error  quaternion,  uermr,  is  the  axis  of  rotation  from  ^aircraft 
to  ^desired-  To  find  amax,  the  vector  component  of  the  error  quaternion  is  projected  into  the  image 
frame.  Similarly,  we  can  project  the  first  three  components  of  the  error  quaternion,  [rj \e  r\2e  rl3e]Ti 
into  the  image  frame  since  this  is  uerror  scaled  by  sin  (a/2)  and  the  magnitude  of  the  vector  is  of 
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no  import  in  the  image  frame.  This  transformation  is  shown  as 
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The  variables  ximage  and  >’jmage  denote  the  2D  vector  direction  of  the  error  quaternion  rotated  into 
the  image  plane.  The  Zimage  component  on  the  left-hand  side  of  Equation  (5.1)  is  not  used  to 
compute  the  direction  of  the  error  quaternion  in  the  image  plane  which  implies  that  the  three- 
dimensional  error  quaternion  is  projected  onto  the  2D  image  plane  of  the  camera.  By  not  using 
the  Zimage  component,  we  are  in  essence  assuming  that  the  aircraft  does  not  roll,  or  at  least  rolls 
very  slowly,  about  its  body  frame  x-axis  once  the  vision-based  navigation  has  commenced.  If  this 
assumption  holds,  then  the  set  of  all  possible  pixel  locations  of  the  centroid  of  the  target,  given  the 
axis  of  rotation,  is  a  line  perpendicular  to  the  vector  [jqmage  yimage]7  that  passes  through  the  current 
centroid  of  the  target.  For  the  practical  application  of  this  research,  we  will  assume  that  the  roll 
rate  is  small.  The  set  of  possible  target  centroid  pixel  locations  is  then  a  straight  line  given  by 


, , -rimage  -rimage  y  y  /<r  ^ 

y —  x  ^tpixel  i  'pixel- 

yimage  yimage 

In  the  undefined  case  that  yjmage  equals  zero,  which  means  that  the  tailsitter  is  directly  over  the 
target  in  the  image  frame  x  direction,  then  the  line  perpendicular  to  [xjmage  yimage] T  is  simply 
x  =  Xpixei.  With  the  line  of  possible  target  locations  known,  the  locations  where  the  line  defined 
in  Equation  5.2  crosses  the  image  boundaries  is  calculated.  These  two  locations  are  called  £j  and 
£2  and  are  shown  in  Figure  5.4.  £1  and  £2  arc  calculated  by  finding  where  the  perpendicular  line 
specified  in  Equation  5.2,  crosses  the  lines;  x  =  0,  x  =  image  width,  y  =  0,  and  y  =  image  height. 
The  intersections  that  lie  at  the  border  of  the  viewable  area  of  the  camera  are  the  variables  £1  and 
£2. 

With  £1  and  £2  known,  amaxi  and  amax2  can  be  calculated  based  on  the  distances  shown 
in  Figure  5.4.  A  short  description  of  each  of  the  distances  needed  to  calculate  ctmaxi  and  amax2  is 
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Figure  5.4:  This  figure  shows  the  angles  amaxi  and  amax2,  the  exit  points  E\  and  E2,  the  axis  of 
rotation  u  in  the  image  plane,  and  the  distances  needed  to  calculate  and  amax2- 


provided  in  the  figure.  The  law  of  cosines  is  used  to  calculate  and  amax2  resulting  in 


'L42  +  L62  +  L72' 

(Wi  =  arccos  |  - -  1 , 


amax2  =  arccos 


2L4L6 

L52  +  L62-L82 
2L5L6 


The  smaller  of  amaxi  and  amaX2  is  the  amax  used  to  recompute  the  error  quaternion  if  amax  is  less 
that  the  original  angle  of  rotation. 

The  original  desired  angle  of  rotation,  aoriginai,  about  the  error  quaternion  can  be  calculated 
with  the  knowledge  that  the  fourth  component  of  the  error  quaternion  is  equal  to  cos  (aoriginai).  If 
a0riginai  is  greater  than  amax,  then  a  rotation  by  the  angle  aoriginai  will  cause  the  target  centroid  to 
leave  the  camera  view  frustum.  For  this  reason  the  error  quaternion  is  recalculated  using  amax. 
Values  for  u\e,  U2e,  and  u?,e  are  obtained  using  the  original  error  quaternion  and  aonginai.  The 
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saturated  error  quaternion  is  then  computed  as 


u  ie  sin  ( 0Cmax/2) 


terror  — 


Uls  sin  ( 0Cmax/2) 
i/3e  sin  ( (Xmax/ 2) 


COS  ( 0Jnlax/2) 


Since  the  first  three  components  of  the  error  quaternion  are  described  in  the  body  frame  and  are 
scaled  by  sin(a/2),  the  error  quaternion  axis  of  rotation  can  be  employed  directly  to  calculate  the 
aircraft  actuator  commands  as 


&a — kpPi 

(5.3) 

II 

.3 

to 

to 

TO 

1 

(5.4) 

sr  =  kV3T)3e  -  krr. 

(5.5) 

as  was  initially  described  in  Section  3.1.1.  As  the  UAV  nears  the  desired  location,  the  scaling  of 
sin  (a /2)  becomes  increasingly  smaller,  consequently,  the  commanded  actuator  input  also  becomes 
smaller.  Damping  is  provided  by  including  roll  rate  ( p ),  pitch  rate  ( q ),  and  yaw  rate  ( r )  terms  to  the 
actuator  calculations.  The  terms  l,  k^2,  k^3,  kp,  kq,  and  kT  are  proportional  and  derivative  gains. 

5.2  Desired  Attitude  Saturation  in  Euler  Angles 

Desired  attitude  saturation  can  also  be  calculated  for  Euler  roll  and  pitch  angles  directly 
from  the  location  of  the  target  origin  in  the  image  plane.  The  resulting  maximum  and  minimum 
roll  and  pitch  angle  will  be  relative  to  the  aircraft’s  current  orientation  and  not  in  reference  to  some 
inertial  coordinate  frame. 

5.2.1  Pitch  Saturation  Angles 

The  maximum  and  minimum  pitch  angles  relative  to  the  aircraft’s  attitude,  as  shown  in 
Figure  5.5,  are  based  on  the  x  location  of  the  target  centroid  in  the  image  frame,  the  horizontal  field 
of  view  of  the  camera  lens,  and  intrinsic  parameters  of  the  camera  itself.  The  relative  maximum 
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(a)  Maximum  and  minimum  pitch 
angles. 


Figure  5.5:  Maximum  and  minimum  euler 


(b)  Maximum  and  minimum  roll 
angles. 


angles  used  to  keep  ground  target  in  view. 


and  minimum  pitch  angles  that  allow  the  onboard  camera  to  see  the  ground  target  of  interest  are 
calculated  as 


0rmax 


0rmin 


tffov 

~Y~ 


—  tan 


tffov 

~Y~ 


+  tan  1 


(5.6) 

(5.7) 


Where  Hfow  is  the  horizontal  field  of  view  of  the  camera  lens  in  radians,  /width  is  the  width  of  the 
image  in  pixels,  -Vp,xei  is  the  centroid  of  the  target  in  the  x  direction  in  units  of  pixels,  and/)  is  the 
A'-dircction  focal  length  of  the  camera  as  derived  from  a  camera  calibration.  The  angles  calculated 
in  Equations  5.6  and  5.7  are  relative  to  the  current  orientation  of  the  aircraft.  This  means  that 
if  the  aircraft  is  at  a  pitch  angle  of  13  degrees,  for  example,  and  the  0,max  and  0rmin  angles  are 
calculated  as  12  degrees  and  36  degrees,  then  the  angles  0max  and  0mm  would  be  25  and  —23 
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degrees  respectively.  The  conversion  from  9rmaJ9rm\n  and  9maJ9m\n  is  performed  as 

©max  —  9  +  ©rmax  >  (5.8) 

©min  =  9  -  ©nn in  ,  (5.9) 

where  0  is  the  current  pitch  angle  of  the  aircraft  as  measured  from  the  inertial  coordinate  frame. 
The  angles  0max  and  0mm  are  then  used  to  saturate  the  ©desired  command  derived  from  the  naviga¬ 
tional  controller. 


5.2.2  Roll  Saturation  Angles 

The  maximum  and  minimum  roll  angles,  as  shown  in  Figure  5.5,  are  based  on  the  y  location 
of  the  target  centroid  in  the  image  frame,  the  vertical  field  of  view  of  the  camera  lens,  and  some 
intrinsic  parameters  of  the  camera  itself.  The  relative  maximum  and  minimum  roll  angles  that 
allow  the  onboard  camera  to  see  the  ground  target  of  interest  are  calculated  as 


0rmax 


0rmin 


Vfov 

2 

Vfoy 

2 


—  tan 

+  tan_1 


^-XpixeA 

-fT-) 

^ -(-pixel) 

fy  ) 


(5.10) 

(5.11) 


The  term  Vfov  is  the  vertical  field  of  view  of  the  camera  lens  in  radians,  /height  >s  the  height  of  the 
image  in  pixels,  ypixei  is  the  centroid  of  the  target  in  the  y  direction  in  units  of  pixels,  and  fy  is  the 
y-direction  focal  length  of  the  camera  as  derived  from  a  camera  calibration.  Similar  to  the  relative 
maximum  and  minimum  pitch  angles,  the  angles  calculated  in  Equations  5.10  and  5.11  are  relative 
to  the  current  orientation  of  the  aircraft.  The  conversion  from  (j)r max/0rmin  to  (j)m ax/0min  is 


0max  —  0  T  ^rmax  >  (5. 12) 

0min  0  0rmin  >  (5.13) 
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Figure  5.6:  This  figure  shows  the  cushion  and  navigation  zones  and  the  angles  Ctmax\  and  amax2 
based  on  those  zones. 


where  (j)  is  the  current  roll  angle  of  the  aircraft  as  measured  from  the  inertial  coordinate  frame.  The 
angles  0max  and  (pniin  are  then  used  to  saturate  the  ^desired  command  derived  from  the  navigational 
controller. 


5.3  Navigation  and  Cushion  Zones 

A  cushion  zone  around  the  inside  of  the  camera  image  is  used  to  prevent  disturbances  from 
forcing  the  target  to  leave  the  image  frame.  This  cushion  zone  also  allows  the  aircraft  to  continue 
to  navigate  towards  the  target  if  the  target  is  at  the  very  edge  of  the  image.  If  the  target  centroid 
is  located  in  this  cushion  zone,  the  aircraft  is  commanded  to  maintain  its  current  x  and  y  positions 
and  gain  altitude  until  the  centroid  moves  out  of  the  cushion  zone  and  into  the  navigation  zone  as 
shown  in  Figure  5.6.  We  also  used  the  cushion  and  navigation  zones  to  calculate  Ctmaxi  and  amax2 
to  account  for  any  underdamped  response  to  the  control  or  overshoot  that  might  cause  the  target 
to  momentarily  leave  the  image  frame.  The  use  of  a  cushion  zone  is  also  advantageous  when  the 
assumption  of  no  roll  rate  after  the  target  has  been  detected  is  violated.  This  is  because  the  use  of  a 
cushion  zone  oversaturates  the  error  quaternion  and  therefore  helps  keep  the  target  in  view  if  slight 
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rolling  occurs.  A  cushion  zone  of  approximately  5  percent  of  the  image  dimensions  was  found  to 
be  adequate  for  keeping  the  target  in  view  in  simulation. 

5.4  Results 

The  method  used  to  saturate  the  desired  attitude  as  described  in  this  chapter  was  validated 
in  simulation  and  in  hardware  to  ensure  that  the  ground  target  used  for  relative  position  estimation 
never  left  the  image  frame.  A  cushion  zone  of  approximately  five  percent  of  the  image  width  was 
also  used  in  simulation  and  hardware  testing  to  ensure  that  the  target  did  not  go  out  of  view.  This 
section  presents  the  attitude  saturation  results  from  simulation  and  hardware  flight  testing. 

5.4.1  Attitude  Saturation  Simulation  Results 

The  desired  attitude  saturation  method  described  in  this  chapter  was  tested  using  the  simula¬ 
tion  environment  described  in  Section  2.1.  The  simulated  tailsitter  was  initialized  at  some  location 
close  to  the  ground  target  to  be  used  for  navigation.  It  was  assumed  that  the  position  of  the  UAV 
was  known  for  navigation  before  the  ground  target  came  into  view.  Once  the  target  came  into  view, 
only  the  estimate  of  the  position  of  the  aircraft  derived  through  vision  was  used  for  navigation. 

The  tailsitter  was  commanded  to  gain  altitude,  maintaining  its  current  position  in  North 
and  East,  until  the  target  came  into  the  onboard  camera’s  view.  Once  the  target  came  into  view,  the 
relative  position  to  the  target  was  calculated  as  described  in  Chapter  4  and  a  desired  attitude  was 
calculated.  The  desired  attitude  was  then  saturated  using  the  method  described  in  this  chapter  if  it 
was  determined  that  the  desired  attitude  would  cause  the  target  to  go  out  of  frame. 

Figure  5.7  shows  the  results  from  one  of  the  simulation  test  runs.  Saturation  of  the  desired 
attitude  occurs  at  15  and  17  seconds  as  is  apparent  from  the  differences  between  the  desired  attitude 
component  (shown  in  blue)  and  the  saturated  desired  attitude  component  (shown  in  green).  When 
no  saturation  was  applied  for  the  same  initial  conditions,  the  target  did  in  fact  go  out  of  the  field  of 
view  of  the  camera  as  is  shown  in  Figure  5.8a.  When  saturation  was  applied,  the  target  never  went 
out  of  view  once  it  entered  the  image  as  is  shown  in  Figure  5.8b. 
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(a)  Comparison  of  the  rji  component  of  the  de-  (b)  Comparison  of  the  772  component  of  the  de¬ 
sired  (d),  and  saturated  desired  (ds)  quaternions.  sired  (d),  and  saturated  desired  (ds)  quaternions. 


(c)  Comparison  of  the  773  component  of  the  de¬ 
sired  (d),  and  saturated  desired  (ds)  quaternions. 


(d)  Comparison  of  the  774  component  of  the  de¬ 
sired  (d),  and  saturated  desired  (ds)  quaternions. 


Figure  5.7:  Comparison  of  the  desired,  and  saturated  desired  quaternion  components  from  simula¬ 
tion. 


5.4.2  Attitude  Saturation  Hardware  Results 

The  method  of  desired  attitude  saturation  described  in  this  chapter  was  also  tested  using 
the  flight  test  setup  described  in  Section  2.2.  The  helicopter  took  off  from  a  location  about  one 
meter  from  the  ground  target  and  gained  altitude  until  the  target  came  into  view.  Position  estimates 
from  the  VICON  motion  capture  system  were  initially  used  to  control  the  aircraft  until  the  target 
came  into  view.  Once  the  target  was  in  view,  the  position  of  the  UAV  was  estimated  using  vision 
as  described  in  Chapter  4  and  the  attitude  saturation  techniques  described  in  this  chapter  were  used 
to  keep  the  target  in  view.  The  UAV  then  navigated  over  the  target,  using  both  the  vision-based 
position  estimation  and  attitude  saturation  techniques,  and  descended  until  it  reached  the  target. 
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(a)  Location  of  the  target  centroid  in  the  image  (b)  Location  of  the  target  centroid  in  the  image 

frame  when  no  saturation  is  applied  to  the  desired  frame  when  saturation  is  applied  to  the  desired  at- 

attitude.  titude  to  keep  the  target  centroid  in  view. 

Figure  5.8:  Location  of  the  target  centroid  in  the  image  frame  in  simulation,  the  rectangle  defines 
the  onboard  camera’s  view. 

Figure  5.9  shows  the  location  of  the  target  centroid  in  the  image  frame  for  all  ten  hard¬ 
ware  test  flights.  These  ten  test  flights  show  the  flight  data  from  the  instance  that  the  vision-based 
controller  was  turned  on  with  the  ground  target  in  view  of  the  onboard  camera  until  the  aircraft 
descended  to  an  altitude  of  0.5  meters  over  the  target.  These  ten  test  flights  also  implemented  the 
desired  attitude  saturation  technique  described  in  this  chapter  to  keep  the  ground  target  in  view  for 
the  duration  of  the  flight.  As  can  be  seen  in  Figures  5.9d,  5.9f,  5.9i,  and  5.9j,  the  target  did  not 
always  stay  in  the  image  frame  even  with  the  use  of  the  desired  attitude  saturation  technique  de¬ 
scribed  in  this  chapter.  However,  as  the  flight  data  in  Figure  5.10  shows,  the  ground  target  centroid 
would  have  never  gone  out  of  view  if  the  UAV  had  tracked  the  commanded  attitude  value.  Figure 
5.10  shows  the  location  of  the  target  centroid  in  the  image  frame  if  the  UAV  had  achieved  the 
desired  attitude  commanded  to  it.  The  implications  of  this  figure  are  important  because  it  shows 
that  while  the  target  centroid  did  not  always  stay  in  the  image  frame,  this  UAV  was  never  com¬ 
manded  to  an  attitude  that  would  force  the  target  centroid  out  of  the  image  frame.  Therefore,  we 
can  attribute  the  instances  in  which  the  target  centroid  left  the  image  frame  to  the  UAV’s  inability 
to  track  a  desired  attitude  with  enough  precision  to  prevent  to  target  from  leaving  the  image  frame. 

In  hardware  flight  testing  the  target  would  often  go  out  of  view  and  not  be  regained  at 
altitudes  below  18  inches.  This  is  attributed  to  the  fact  that  the  oscillatory  behavior  of  the  helicopter 
as  seen  in  Figures  3.4a  and  3.4b,  has  a  greater  effect  on  what  is  seen  in  the  image  frame  at  lower 
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(a)  Test  flight  1 
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(b)  Test  flight  2. 


(c)  Test  flight  3. 


(d)  Test  flight  4. 


(e)  Test  flight  5.  (f)  Test  flight  6. 

Figure  5.9:  Location  of  the  target  centroid  in  the  image  frame  from  the  different  test  flights,  the 
rectangle  defines  the  onboard  camera’s  view. 
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(i)  Test  flight  9.  (j)  Test  flight  10. 

Figure  5.9:  Location  of  the  target  centroid  in  the  image  frame  from  the  different  test  flights,  the 
rectangle  defines  the  onboard  camera’s  view. 


attitudes.  Ground  effects  from  flying  close  to  the  ground  could  also  account  for  this  occurrence. 
For  this  reason,  the  plots  shown  in  Figure  5.9  only  present  flight  data  down  to  0.5  meters  altitude 
AGL. 

Figure  5.11  shows  an  example  of  when  desired  attitude  saturation  was  used  to  keep  the 
target  in  the  image  frame  in  flight  testing.  The  desired  pitch  angle  as  calculated  from  the  naviga¬ 
tional  controller  is  shown  as  a  red  dashed  line  while  the  minimum  and  maximum  pitch  angles  are 
shown  in  green.  Saturation  of  the  desired  pitch  angle  occurs  when  the  desired  pitch  angle  is  not 
between  the  maximum  and  minimum  pitch  angles.  At  times  when  the  desired  pitch  angle  is  not  in 
the  window  of  acceptable  pitch  angles  the  nearest  saturation  value  is  used  in  its  place.  Saturation  of 
the  desired  pitch  angle  can  be  seen  in  Figure  5.11  at  times  beginning  at  83  seconds  and  occurring 
periodically  throughout  the  figure.  For  the  data  shown,  the  pitch  angle  experiences  1 1  saturation 
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(a)  Test  flight  4. 


(b)  Test  flight  6. 


(c)  Test  flight  9.  (d)  Test  flight  10. 

Figure  5.10:  Location  of  the  target  centroid  in  the  image  frame  from  the  different  test  flights  if  the 
UAV  had  achieved  the  desired  attitude,  the  rectangle  defines  the  onboard  camera’s  view. 


Figure  5.11:  This  figure  shows  the  the  desired  attitude  in  red  as  calculated  from  the  navigational 
controller  and  the  maximum  and  minimum  desired  attitude  limits  in  green,  saturation  occurs  when 
the  desired  attitude  is  outside  of  the  saturation  window. 
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occurrences  and  the  figure  ends  in  a  state  of  saturation.  Using  this  window  of  acceptable  pitch 
and  roll  values  enabled  the  helicopter  to  navigate  over  the  ground  target  while  preventing  a  desired 
attitude  to  be  commanded  that  would  cause  the  target  to  move  outside  the  image  frame. 


Table  5.1  shows  the  saturation  occurrences  for  all  ten  test  flights  as  well  as  the  cumulative 
time  that  the  desired  attitude  was  saturated.  A  noticeable  difference  can  be  seen  between  tests  one 
through  six  and  tests  seven  through  ten  where  much  fewer  saturation  occurrences  are  observed. 
This  is  attributed  to  the  compiling  method  used  to  run  the  vision  navigation  algorithm  in  C++ 
for  these  tests.  Specifically  tests  seven  through  ten  were  compiled  in  debug  mode  while  tests 
one  through  six  were  compiled  in  release  mode.  This  means  that  the  vision  programs  in  tests 
one  through  six  were  running  much  faster  and  many  more  saturation  occurrences  are  seen  as  a 
consequence. 

We  did  not  collect  vision-based  landing  flight  test  data  with  the  desired  attitude  saturation 
algorithm  turned  off.  However,  we  see  from  Table  5.1  that  each  flight  test  had  several  instances 
when  a  desired  attitude  would  have  been  commanded  that  would  have  sent  the  target  centroid  out 
of  the  image  frame  if  the  attitude  saturation  algorithm  had  not  been  used. 


Table  5.1:  Attitude  saturation  flight  results 


Flight  Test 

saturation  occurrences 

time(s) 

1 

27 

9.6 

2 

24 

3.75 

3 

13 

5.35 

4 

16 

2.6 

5 

22 

9.35 

6 

24 

5.2 

7 

3 

0.75 

8 

4 

0.25 

9 

6 

0.5 

10 

4 

3.45 
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CHAPTER  6.  CONCLUSIONS  AND  RECOMMENDATIONS 


This  chapter  discusses  the  conclusions  that  we  have  reached  as  a  result  of  the  research  pre¬ 
sented  in  this  work.  Our  recommendations  for  future  related  research  and  potential  improvements 
to  the  research  presented  are  also  given. 

6.1  Conclusions 

The  objective  of  this  research  was  to  perform  vision-based  landings  of  a  tailsitter  aircraft 
with  sub-meter  accuracy  using  only  an  onboard  camera,  aircraft  orientation  information  and  the 
aircraft’s  altitude  AGL.  A  method  of  calculating  the  position  of  the  UAV  relative  to  a  visually 
detected  target  was  presented  using  only  the  information  described  above,  and  was  shown  to  have 
an  average  accuracy  of  22  centimeters  in  hardware  flight  testing. 

One  of  the  main  difficulties  encountered  in  this  research  was  the  problem  of  keeping  the 
ground  target  in  the  camera’s  image  frame  while  still  tracking  desired  attitudes  to  navigate  over 
the  target.  For  this  reason,  one  focus  of  this  research  has  been  in  calculating  the  maximum  and 
minimum  components  of  the  aircraft’s  attitude  that  still  allow  the  ground  target  to  be  visible  to 
the  UAV’s  onboard  camera.  A  method  was  presented  to  find  the  maximum  and  minimum  attitude 
components  of  the  aircraft  that  would  allow  the  UAV  to  rotate  until  the  target  centroid  was  at  the 
edge  of  the  viewing  area.  This  method  was  presented  in  both  quaternion  and  Euler  angle  attitude 
representations.  These  maximum  and  minimum  attitude  values  were  then  used  to  saturate  the 
desired  attitude  so  that  the  aircraft  was  not  commanded  to  an  attitude  that  would  move  the  target 
out  of  the  viewable  image  frame.  The  vision-based  landing  methods  presented  in  this  paper  were 
tested  in  simulation  and  hardware  flight  testing  of  an  autonomously  controller  RC  helicopter.  In  six 
of  the  ten  flight  tests  the  UAV  navigated  over  the  target  and  descended  to  an  altitude  of  0.5  meters 
using  vision  without  causing  the  target  centroid  to  go  out  of  the  camera  view.  In  the  remaining  four 
test  flights  the  target  did  go  out  of  view  of  the  onboard  camera  and  was  eventually  regained  and 
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the  vision-based  landing  procedure  resumed  until  the  UAV  reached  an  altitude  of  0.5  meters  above 
the  target.  Upon  further  investigation  into  these  four  test  flights  we  found  that  the  UAV  was  never 
commanded  to  an  attitude  that  would  have  caused  the  target  to  leave  the  image  frame.  Instead  the 
target  left  the  image  frame  due  to  the  inability  of  the  UAV  to  precisely  track  a  desired  attitude. 

As  mentioned  in  Chapter  1,  the  research  presented  in  this  work  could  have  direct  applica¬ 
tions  in  both  the  civilian  and  military  marketplaces.  With  the  research  and  conclusions  that  we 
have  presented  it  is  easy  to  see  that  VTOL  UAVs  already  have  the  technology  at  hand  to  perform 
precision  drop  missions  with  submeter  accuracy,  perch-and- stare  missions  from  a  platform  with 
a  sufficiently  large  base,  and  precision  landings  with  submeter  accuracy.  The  ability  to  land  with 
such  accuracy  allows  the  UAV  to  land  in  a  variety  of  GPS  denied  environments  such  as  urban 
canyons  and  thickly  forested  regions,  or  at  locations  where  GPS’s  accuracy  is  insufficient  such  as 
on  a  ship  deck.  Much  of  the  research  that  we  have  performed  acts  as  a  foundation  for  further  re¬ 
search  that  could  extend  the  capabilities  of  unmanned  VTOL  aircraft  and  precision  landings  even 
further. 

6.2  Recommendations  for  Future  Work 

There  are  several  aspects  of  our  work  that  could  be  extended  to  further  the  capabilities  of 
unmanned  VTOL  flight.  In  this  section  we  will  discuss  possible  research  directions  that  we  feel 
would  yield  valuable  results. 

The  method  we  have  presented  for  vision-based  landings  is  dependent  on  an  estimate  of 
the  aircraft’s  attitude  that  we  assume  is  known.  It  is  likely  that  this  estimate  would  come  from  an 
onboard  inertial  measurement  unit  (IMU).  Using  more  complicated  target  geometry  and  computer 
vision  techniques  similar  to  those  presented  in  [24]  and  [14, 15],  it  is  possible  to  solve  for  the  full 
pose  of  the  aircraft  from  vision  if  there  is  sufficient  information  known  about  the  ground  target’s 
geometry.  This  reduces  the  amount  of  hardware  required  for  a  UAV  to  navigate  autonomously  and 
therefore  allows  for  smaller  and  lighter  weight  UAVs  to  perform  autonomous  tasks.  This  method 
would  however  seriously  increase  the  computational  workload.  A  more  complex  target  pattern 
or  geometry  could  also  allow  the  UAV  to  navigate  all  the  way  to  the  ground  without  the  target 
completely  filling  the  image  frame  therefore  losing  some  position  accuracy. 
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The  research  we  have  presented  has  been  in  landing  a  VTOL  UAV  on  a  static  ground  target. 
The  task  of  landing  a  VTOL  UAV  on  a  moving  target  has  unique  challenges.  Much  like  the  problem 
of  having  to  tilt  the  UAV  towards  the  target  and  therefore  forcing  the  target  out  of  view  described 
in  Chapter  5,  landing  on  a  moving  target  is  further  complicated  by  the  target  itself  moving  outside 
of  the  image  frame.  This  scenario  would  lead  to  smaller  attitude  saturation  angles  and  further  limit 
the  aircraft’s  ability  to  track  the  moving  target.  Further  research  could  look  into  gimballing  the 
onboard  camera  to  track  or  land  on  a  moving  target  or  to  enable  vision-based  navigation. 

Future  research  could  also  be  performed  in  bounding  the  position  error  at  times  when  the 
ground  target  goes  out  of  view  with  the  use  of  a  Kalman  filter  or  extended  Kalman  filter.  Infor¬ 
mation  from  optic  flow  sensed  in  the  image  frame,  or  from  rate  gyros  and  accelerometers  from 
the  onboard  IMU,  could  be  used  to  approximate  the  UAV’s  movement  since  the  last  instance  that 
the  ground  target  had  been  acquired  in  the  image  frame.  This  technique  would  aid  in  reacquiring 
the  ground  target  if  the  UAV  ever  lost  sight  of  the  ground  target.  Vision-based  estimates  of  posi¬ 
tion  could  also  be  combined  with  GPS  and  IMU  data  in  a  Kalman  filter  to  obtain  a  more  reliable 
position  estimate. 

When  performing  the  maximum  and  minimum  attitude  calculations  in  Chapter  5,  we  as¬ 
sumed  that  the  aircraft  did  not  roll  or  rolled  very  slowly.  Further  research  could  address  keeping 
the  ground  target  in  view  of  an  onboard  camera  while  allowing  for  rolling  of  the  tailsitter  aircraft. 

Finally,  when  performing  the  position  estimation  of  the  UAV  relative  to  the  target  in  Chap¬ 
ter  4,  a  flat  earth  assumption  was  made.  In  several  situations  the  approximation  that  the  ground 
over  which  the  UAV  is  flying  is  flat,  holds  for  the  small  window  of  the  Earth  that  we  are  con¬ 
sidering.  At  other  times,  however,  such  as  flying  over  an  urban  environment  with  tall  buildings, 
this  assumption  does  not  hold.  If  the  target  of  interest  is  located  in  a  highly  non-planar  scene,  the 
landing  method  that  we  have  proposed  may  not  work.  Further  research  could  address  vision-based 
landings  in  such  environments. 
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APPENDIX  A.  DERIVATION  OF  THE  DESIRED  QUATERNION 


For  completeness,  the  derivation  of  the  desired  quaternion  in  hover  flight  is  shown  as  taken 
from  Ref.  [5].  The  notation  used  to  represent  the  different  components  of  a  quaternion  is 


where, 


5 


V(-) 


|  n2(.)  h 

V  n3(.)  J 


and  the  symbol  (•)  is  the  location  where  the  name  of  the  specific  quaternion  is  given.  Using  this 
notation,  the  equation  for  the  desired  quaternion  is 


V  desired  V  correction  ®  V  vertical  > 


(A.l) 


where  ^vertical  is  the  vertical  quaternion  which  points  straight  up  in  the  vehicle  frame  and  is  defined 
as 
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The  (8)  symbol  denotes  quaternion  multiplication  and  is  defined  as 


t?"  =  t?'®77  =  (  77477'  +  77477  -r\'  x  T]  )  •  (A. 2) 

The  x  symbol  in  Equation  (A. 2)  simply  denotes  the  cross  product  of  two  vectors. 

The  term  r\ correction  >n  Equation  (A.l)  is  the  primary  correction  quaternion  that  describes 
the  rotation  needed  for  x-y  position  tracking  in  the  inertial  frame  and  is 


correction 
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(A. 3) 


The  term  77  cp  from  Equation  (A. 3)  is  the  correction  quaternion  based  on  the  position  error  and  is 
defined  in  as 
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and  T74cp  =  y||  e, 


The  terms  xci  and  yj  refer  to  the  desired  position  of  the  aircraft  in  the  inertial  frame,  y  is  a  gain,  and 
||  ||  is  the  norm  of  the  position  error  and  is  defined  as 


<?„  = 
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The  term,  77 cv,  from  Equation  (A. 3)  is  the  correction  quaternion  based  on  body  frame  ve¬ 
locities  and  provides  damping,  it  is  defined  as 


The  terms  v  and  w  refer  to  the  body  frame  velocities  of  the  aircraft  in  the  y-axis  and  z-axis 
directions  respectively.  The  term  £  is  a  gain. 
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APPENDIX  B.  SIMULATION  FORCES,  TORQUES,  AND  EQUATIONS  OF  MOTION 


The  basic  simulation  method  of  integrating  the  standard  quaternion  based  non-linear  trans¬ 
lational  and  rotational  kinematic  and  dynamic  equations  for  a  six  degree-of-freedom  rigid-body 
aircraft  was  applied.  Forces  and  torques  used  by  the  equations  of  motion  were  generated  from 
simple  models  of  the  motor/propeller  system,  level  flight  aerodynamics,  and  propeller  wash  aero¬ 
dynamics. 

Physical  aircraft  parameters  used  in  simulation  can  be  seen  in  Figure  B .  1 .  The  actual  values 
used  in  calculations  with  brief  descriptions  are  shown  in  Table  B.l.  Note  that  sensors  used  in  the 
simulated  algorithms  are  also  emulated  in  the  described  simulation  environment.  Appropriate 
update  rates,  noise,  and  biases  typical  of  the  sensors  were  applied. 

B.l  Propeller  Forces  and  Torques 

Modeling  of  the  propulsion  system  will  be  discussed  in  this  section.  Assumptions  about  the 
system  are  made  based  upon  propulsion  test  results  performed  on  the  ground  (static  tests).  These 
assumptions  are  then  used  to  produce  a  simple  model  of  propeller  wash  airflow,  and  ultimately  of 
thrust  and  propeller  induced  torque. 

From  static  testing  (see  Chapter  4  of  [6]),  it  has  been  found  that  there  is  a  linear  relationship 
between  propeller  angular  rate  ( (op )  and  both  the  percent  throttle  setting  (5r)  and  battery  voltage 

(E): 

(top  —  Eapo  T Cq)PjeE  +  .  (B.l) 

Thrust  system  parameter  values  used  in  simulation  were  similar  to  those  found  in  hardware  testing, 
namely  CWp 0  =  -356,  Ca^E  =  46.6,  and  Cap  8t  =  7.28. 
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dp 


Figure  B.l:  Tailsitter  geometry  is  shown  with  nomenclature. 


Table  B.l:  Table  of  physical  parameters  used  in  simulation 


Variable 

Value 

Description 

Sw 

0.203 

Wing  area,  nr 

St 

0.151 

Tail  area,  m2 

cw 

0.230 

Wing  cord,  m 

Ct 

0.120 

Tail  cord,  m 

(-'en 

0.120 

Elevon  cord,  m 

cr 

0.120 

Rudder  cord,  m 

bw 

1.0 

Wing  span,  m 

bt 

0.280 

Tail  span,  m 

Lyv 

0.038 

x  distance  from  center  of  gravity  to  wing  aerodynamic  center,  m 

Lt 

0.181 

x  distance  from  center  of  gravity  to  wing  aerodynamic  center,  m 

ya 

0.130 

y  distance  from  center  of  gravity  to  outer  edge  of  elevon,  m 

yi 

0.010 

y  distance  from  center  of  gravity  to  inner  edge  of  elevon,  m 

dp 

0.280 

Propeller  diameter,  m 

dpw 

0.280 

Propeller  wash  diameter,  m 

8 

9.81 

Gravity,  m/s2 

P 

1.307 

Mass,  kg 

P 

1.27 

Air  density,  kg/m2 

d XX 

0.315 

jc-axis  moment  of  inertia,  kg-m2 

Jyy 

0.200 

y-axis  moment  of  inertia,  kg-m2 

Jzz 

0.058 

z-axis  moment  of  inertia,  kg-m2 

Jxz. 

0.000 

cross-product  of  inertia,  kg-m4 
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The  flow  of  air  exiting  the  propeller  has  also  been  found  to  have  a  linear  relationship  with 
propeller  angular  rate  in  similar  propulsion  tests  (see  Chapter  4  of  [6]),  given  as 

Vp  =  Cyp0}pG)p,  (B.2) 

where  CypMp  —  0.02310,  as  found  from  static  testing.  For  simplification  we  assume  that  these  two 
relationships  remain  consistent  in  all  flight  conditions.  Under  these  assumptions  the  propeller  wash 
airspeed  is  defined  as  the  difference  between  the  propeller  and  aircraft  airspeed: 


vpw  =  vp-v. 


(B.3) 


Using  momentum  theory  and  noting  that  V  and  Vp  are  the  entrance  and  exit  velocities,  the  thrust  is 
found  to  be 

Fx-p  =  ^pAp{Vf}  -V2).  (B  .4) 

Propeller  induced  torque  is  modeled  simply  with  the  non-dimensional  torque  coefficient 


(B.5) 


with  Ci  p  =  0.000390. 

B.2  Propeller  Wash  Forces  and  Torques 

For  propeller  wash  forces  and  torques,  a  simplified  aerodynamic  model  was  derived.  This 
model,  briefly  discussed  in  this  section,  is  based  on  the  following  assumptions: 

•  Aerodynamic  propeller  wash  lift/drag  forces  due  to  the  body  are  negligible. 

•  Aerodynamic  propeller  wash  control  forces  are  generated  only  by  deflections  of  control  sur¬ 
faces  located  within  the  propeller  wash  region. 

•  Flow  in  the  propeller  wash  region  remains  parallel  to  the  body  jt-axis. 

•  The  only  significant  aerodynamic  propeller  wash  forces/moments  are  lifting  surface  normal 
forces  (which  may  induce  moments)  and  lifting  surface  moments. 
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Propeller  wash  forces  (Fx_pw,  Fy_pw,  and  Fz_pw)  and  moments  (lpw,  mpw,  and  npw)  in  the 
body  reference  frame  are  functions  of  propeller  wash  velocity  (Vpw)  and  the  angular  deflection  of 
the  aileron  elevator  (Se),  and  rudder  (Sr)  control  surfaces: 

Fx—pw  =  0.0, 

Fy—Pw  =  Fr(Vpw.  8r)  J 

Fz—pw =  Fe(Vpw,8e), 

lpw  =  Maiy pwi  &ci)i 

mpw  =  Fe{Vpw,  8e)Len  +  M e{y pw .  Se) , 
ftpw  =  Fr(Vpw,  8r)Lr  +  Mr(ypw,  8f ■). 

Note  that  the  actuator  sign  convention  was  chosen,  such  that  positive  deflections  of  ailerons,  ele¬ 
vators,  and  rudders  resulted  in  positive  torques  about  the  v-axis,  y-axis,  and  z-axis  respectively. 

B.2.1  Aileron 

Although  the  actual  control  surfaces  used  to  produce  pitching  and  rolling  moments  will 
be  elevons,  the  aerodynamic  forces  can  be  separated  into  aileron  and  elevator  contributions.  The 
ailerons  produces  a  moment  about  the  v-axis  only.  A  simple  method  for  estimating  the  rolling 
moment  induced  by  the  ailerons,  called  strip  theory,  multiplies  the  local  section  lift  increment  due 
to  the  aileron  deflection  by  the  local  moment  arm  and  integrates  over  the  wing. 

The  change  in  lift  coefficient  of  the  wing  for  a  two  dimension  (2D)  wing  section  as  a 
function  of  aileron  deflection  is 


(A  CLw)8a 


FC pwx/_£en8, 


’a  5 


(B.6) 


where~is  used  to  denote  2D  section  properties,  £en  the  elevon  efficiency,  and  a  the  angle  of  attack. 
For  a  symmetric  deflection  of  the  ailerons,  the  moment  coefficient  about  the  v-axis  is  given  by  strip 
theory  as 

n  2Cpw  a  f y°  ~ 

Cisa  =  — — —  /  y£encwdy.  (B.7) 

Jyi 
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This  can  be  simplified  even  further  by  assuming  that  the  wing  chord  length  (cw)  is  constant 


with  span,  as  is  the  aileron  size.  This  yields 


cesa 


Clw.u 

Swbw 


£enC\v  {yo 


(B.8) 


Finally,  assuming  no  rolling  moment  is  produced  at  zero  aileron  deflection,  the  dimensional  mo¬ 
ment  produced  by  an  aileron  deflection  is 


Ma  = 


\pv^ 


a^enCw 


(B.9) 


where  y;  is  the  body  y-coordinate  of  the  inner  most  edge  of  the  elevon,  and  y0  the  outer  most  edge 
of  the  elevon  or  the  coordinate  of  the  outer  most  edge  of  the  slipstream.  The  lift  slope  for  the  2D 
wing  sections  can  be  approximated  as 

27T,  (B.IO) 

and  from  thin  airfoil  theory  (see  for  instance  Ref.  [25])  the  elevon  efficiency  is 


with 


1- 


Oen 


sin(ge„) 

n 


(B  .11) 


(B.12) 


B.2.2  Elevator 

The  elevators  produce  a  force  in  the  body  z-direction  and  a  corresponding  moment  about 
the  body  y-axis.  Again  using  strip  theory,  we  integrate  the  section  change  in  lift  coefficient  over 
the  spanwise  extent  of  the  control  surface 


n  _  2CLw,a  fy°  ~ 

Cz,8e  —  ,,  /  £encwdy. 

Ow  Jyi 


(B.13) 
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Assuming  symmetry  about  the  y-axis  and  that  the  wing  chord  and  elevon  geometry  are  constant 
along  the  span,  yields 


CzA  = 


2  ClW(x 


£enC\v{yo  yi) 


(B.14) 


or 


Fe  =  pv;w 


cw{y0-yi ) 


( B  .15) 


with  the  wing  lift  slope  and  elevon  efficiency  defined  in  equations  (B.10)  and(B.19),  respectively. 

Using  a  very  similar  analysis,  the  elevator  pitching  moment  about  the  lifting  surface  quarter 
chord  is 

Me  =  pvfmcm^8ecw(y0  -  Vi)  (B.l  6) 


where,  from  thin  airfoil  theory,  we  can  approximate  the  moment  coefficient  as 


F-m,Se 


sin(2<7e„)  —  2sin(cei 


(B  .17) 


with  oen  defined  in  Equation  (B.12). 


B.2.3  Rudder 

The  rudders  produces  a  force  in  the  body  y-dircction  and  a  corresponding  moment  about 
the  body  z-axis.  Using  an  approach  similar  to  that  employed  for  the  elevator  and  referring  to  the 
sketch  in  Figure  B.l,  we  find  the  force  produced  by  the  rudders  is 

Fr  -  kpVpW  ( SrCLt,a£r )  C,ds.  (B .  1 8) 


The  section  lift  slope  is  again  approximated  as  Cl, 


t,a 


£,-  PS  1 


2 n  and  the  rudder  efficiency  is 

sin(a>) 

n 


(B.l  9) 


with 


(B.20) 
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Finally,  the  moment  produced  about  the  lifting  surface  quarter-chord  due  to  rudder  deflection  is 


Mr  2  PVpwCin,Sr&rdsCt , 


(B.21) 


where 


sin(2cx,)  —  2sin(crr) 

4 


(B.22) 


B.3  Level  Flight  Forces  and  Torques 

Level  flight  forces  and  torques  are  produced  from  typical  aerodynamic  modeling  methods. 
Aerodynamic  coefficients  are  utilized  to  describe  approximate  linear  relationships  of  system  inputs 
and  states  to  forces  and  torques.  These  coefficients  include  lift  (Cl),  drag  (Co),  lateral  force  (Cy), 
rolling  moment  (Q),  pitching  moment  (Cm),  and  yawing  moment  (Cn).  The  inputs  into  the  system 
involved  with  aerodynamic  forces  and  torques  modeling  are  actuator  angular  deflections  from  trim 
(8a,  8e,  and  8r),  while  the  states  include  airspeed  (V),  angle  of  attack  (a),  sideslip  angle  (/ 3),  and 
angular  rates  (p,  q,  and  r)  about  principle  body  reference  frame  axes.  Actual  coefficients  used  in 
simulation,  as  well  as  brief  descriptions,  are  shown  in  Table  B.2. 

Given  the  aerodynamic  coefficients  described  earlier,  the  forces  can  be  modeled  as 

Fx_iev  =  ^pV2Sw  ^  -  cos  aCD o  -  sin  aCL0  -  cos  aCDi0l \ a\  -  sin aCL:Ua 

-  cos  aCDtqy\q\  -  sin  aCL,qyq  -  cos  aCD  §e  \ 8e\  -  sin  aCL  8e8^j , 

Fy-lev  —  ^Cyo  +Cy jg/3  +Cy;/,— p  +  Cy;/-— r  +  CY£a8a  +  Cy^S^j  , 

1  2  / 

Fz_iev  =  -pV  Sw  I  —  sin ccCdq  —  cos  ocClq  —  sin  uCu.a \ Cf  |  —  cos 

c  c  \ 

-  sin  aCD.q y  I q\  -  cos  aCL^q y  q  -  sin  aCD  Se  \  8e \  -  cos  aCL A  8e  j , 


(B.23) 


(B.24) 


(B.25) 
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Table  B.2:  Table  of  level  flight  coefficients 


Variable 

Value 

Description 

Cm 

0.00 

Nominal  lift  coefficient 

Cl, a 

3.45 

Lift  coefficient  with  respect  to  angle  of  attack 

CL,q 

0.00 

Lift  coefficient  with  respect  to  pitch  rate 

CLA 

-0.360 

Lift  coefficient  with  respect  to  elevator  deflection 

Cdo 

0.0300 

Nominal  drag  coefficient 

Cd,oc 

0.300 

Drag  coefficient  with  respect  to  angle  of  attack 

Cda 

0.00 

Drag  coefficient  with  respect  to  pitch  rate 

Cda 

0.00 

Drag  coefficient  with  respect  to  elevator  deflection 

Cyo 

0.00 

Nominal  lateral  force  coefficient 

Cy.p 

-0.980 

Lateral  force  coefficient  with  respect  to  sideslip  angle 

Cy.p 

0.00 

Lateral  force  coefficient  with  respect  to  roll  rate 

Cy,r 

0.00 

Lateral  force  coefficient  with  respect  to  yaw  rate 

CY.<% 

0.00 

Lateral  force  coefficient  with  respect  to  aileron  deflection 

Cy.8, 

0.170 

Lateral  force  coefficient  with  respect  to  rudder  deflection 

C/0 

-0.100 

Nominal  roll  moment  coefficient 

C/,/3 

0.0200 

Roll  moment  coefficient  with  respect  to  sideslip  angle 

Q,p 

-0.200 

Roll  moment  coefficient  with  respect  to  roll  rate 

Q,r 

0.00 

Roll  moment  coefficient  with  respect  to  yaw  rate 

Cl,8a 

4.40 

Roll  moment  coefficient  with  respect  to  aileron  deflection 

CIA 

0.00 

Roll  moment  coefficient  with  respect  to  rudder  deflection 

C/nO 

0.0150 

Nominal  pitch  moment  coefficient 

Cm,  a 

-0.380 

Pitch  moment  coefficient  with  respect  to  angle  of  attack 

Cm,q 

-3.60 

Pitch  moment  coefficient  with  respect  to  pitch  rate 

Cm,8e 

3.40 

Pitch  moment  coefficient  with  respect  to  elevator  deflection 

C/;0 

0.0100 

Nominal  yaw  moment  coefficient 

Cn.fi 

0.250 

Yaw  moment  coefficient  with  respect  to  sideslip  angle 

Cn,p 

0.0220 

Yaw  moment  coefficient  with  respect  to  roll  rate 

c 

n,r 

-0.350 

Yaw  moment  coefficient  with  respect  to  yaw  rate 

Cn,8a 

0.00 

Yaw  moment  coefficient  with  respect  to  aileron  deflection 

C>i.8, 

3.60 

Yaw  moment  coefficient  with  respect  to  rudder  deflection 

and  the  torques  similarly  as 


1 


2  2 
7  2 


hev—  ^pV  Sw—  (  C/o  +  C/0/3  +CiP—p  +  Cif—r  +  Ci:sa8a  +  Ci  gr8r ), 


2V 


miev  —  2^  SwCw  (cm o  +  Cm^ccCC  +  Cm^q  y  c[-\-  Cm§e8e  J  5 


1  V2r  bw  { ^  ^  o  >  n  bw  _  h 


nlev  ^  P  ^  2  (  CnO  +  Cnpj5  +  Cnp  ryi/P  ”b  r  +  Cn§a8a  +  Cngr8] 


2V1 


w 

2V 


( B.26 ) 
(B.27) 
(B.28) 
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This  method  is  a  reasonable  approximation  in  non-stall  conditions,  and  is  therefore  used  only  if 
the  angle  of  attack  is  reasonable: 


C^stall  —  ^  Costal  I ■  (B.29) 

If  this  condition  does  fail  (indicating  stall)  only  drag  is  applied.  The  force  model  can  then  be 
written  as 


Fx —lev 
Fy-lev 
Fz—lev 


-pV~Sw[  —  cos  aCDQ  —  cos  aCo,a \ cc \  ), 


-pV~Sw  (  Cyo  +  Cy  j 3/3  , 


-pV~Sw[  -  sin  aCD0-  sin  aCDfU \ «|  ), 


and  the  torque  model  is  simply 


l  lev  =  0.0, 
miev  =  0.0, 
H- lev  =  0.0. 


(B.30) 
(B  .31) 
(B.32) 


(B.33) 

(B.34) 

(B.35) 


B.4  Equations  of  Motion 

The  tailsitter  simulation  relies  on  the  time  integration  of  equations  of  motion  in  order  to 
propagate  aircraft  states.  The  conventional  quatemion-based  13-state  model  is  applied.  These 
states  include  body  reference  frame  velocities  ( u ,  v,  and  w )  and  angular  rates  (p,  q,  and  r).  Also 
included  are  the  quaternion  attitude  elements  (rp,  172 ,  t]3>  and  V4)  and  the  inertial  position  (x,  y, 
and  z). 
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Using  Newton’s  second  law,  aircraft  linear  and  angular  dynamics  can  be  derived  as 


and 


Fx 

u  =  rv~?.qw  +  g(2TliTl3-*2Tl4T}2)  +  —, 

P 

f 

v  —  —ru  +  pw  +  g(2T]2^]3  "b  2tj4T]i)  H 

M 

w  —  qu  —  pv  +  g{r\4r\4  - 171171  - 172172  + 173773)  + 


(B.36) 

(B.37) 

(B.38) 


Jxz.(Jxx  Jyy  +  Jzz)  Jzz(Jzz  Jyy)  3“  Jxz. 

P  = - .  ,  ' '  , - pq  ~ 


+ 


JxxJzZ 

J 77 


-J  2 

Jxz 

-l  + 


I  I  —  J2 

JXXJZ7  J  r- 


qr 


xz 


J 


xz 


- “I - T-"; 

JxxJ. ZZ  ~  Jy  7  JxxJ. ZZ.  J Y7 


q  = 


JxxJ  ZZ 

Jzz~  Jx 


r 


■ 


Jyy 
Jzz  (Jzz  ' 


Jxz  JXXJZZ  JXZ 

k  Jxz  t  2  2\  ,  1 

-pr-—{p  —  r  )  +  —m, 

Jyy  J  V 


■'xy 


-/>■).)  +  Jxz 


J  J  ~  J2 

JXXJZZ  Jxz 


J 


xz 


JxxJ 


xxJzz 


J2 

Jxz 


l  + 


pq- 

Jzz 


Jxz.(Jxx  Jyy  T  Jzz) 

J  J  —  I2 

J  XXJ  77  J  v? 


qr 


JxxJzZ 


J2 

JXZ 


n. 


(B.39) 
(B  .40) 


(B.41) 


Observe  that  Fx,  Fy,  and  F-  represent  the  resulting  sum  of  forces  in  the  associated  body  frame 
directions  and  /,  m,  and  n  are  the  resulting  torques  about  the  associated  axes.  The  aircraft  attitude 
kinematics  are  described  by  the  quaternion  derivative 


(B  .42) 

V2  =  ^(mp  +  fyq-mr), 

(B.43) 

vs  =  ^(-V2P+viq+V4f), 

(B  .44) 

1,  , 

V4  =  ^(-ViP-Viq-Vsr), 

(B.45) 
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while  the  inertial  position  time  derivative  is  given  simply  from  rotating  the  body-frame  linear 
velocities  into  the  inertial  reference  frame: 

x  =  u(rj4ri4  +  771  rji  -  T72T72  - 173173)  +  v(2t72T7i  -  2174173)  +  ^(2773771  +  2174172),  (B.46) 

>’  =  w(2t7iT72  +  2174173)  +  v(t74T74  -  771771  + 172172  -  773773)  +  w(2t73T72  -  2774771),  (B.47) 

z  =  m(2t7i773  -  2774772)  +  v(2tj2tj3  +  2774771)  +  >^(774774  -  771771  -  772772  +  773773).  (B.48) 
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